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(57) A vehicle drive assist system comprising a 
camera (10) for picking up an image of an area existing 
in an advancing directk>n of a vehicle; display means (4) 
for displayhg the rnnage picked up by the camera; steer- 
ing angle detecting means (1 2) for detecting a steering 
angle for steering the vehicle; traveling path predating 
means (20) for predk;ting a traveling path dt the vehicle 



on the basis of the steering angle detected by the steer- 
ing angle detecting means; and drive assist means for 
overlaying on the display means drive assist infomriatksi 
containing the vehfcle predkrtive traveling path predat- 
ed by the traveling path predicting means and gukie 
tines protonged from the lines defining the width of the 
vehicle body on the image of the area exislhg in the 
vehicle advancing directkxi. 
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Description 
* BACKGROUND OF THE INVENTION 

1 . Field of the Inventfon 

[0001] The present invention relates toavehicle park- 
ing assist device for assisting a driver ffi his driving by 
use of an image obtained by taking a scene of an area 
around a vehicle. 

2. Descrption of the Related Art 

[OOOa] To drive a vehicle, e.g.. autonrobile, in safety, 
the driver needs to look traffic conditions around the ve- 
hicle attentively. The driver constantly watches the en- 
vironment of the vehicle and makes efforts to grasp en- 
vironmental conditbns of the v^icle. while driving the 
vehtele. When the grasping effort depends on only the 
sense, there is a limit in perfectly grasping the environ- 
mental conditions. The human visuaJ sensation is very 
important in grasping the environmental conditions. 
However, it is effective only in a direction in which the 
driver looks. The driver must drive the vehksle under the 
conditran that areas that are shaded by the vehcle and 
from driver's view, i.e., the dead spaces, inevitably exist. 
[0003] Major dead spaces as viewed from the driver 
are areas near the wheels and just before arxJ after the 
vehicle body. In the dead spaces near the wheels, the 
driver cannot check the orientatk>ns of the wheels per 
se whose running directions change in accordance with 
a turn erf a steering wheel. The steering wheel may be 
turned by plural turns ri one direction. Accordingly, if the 
steering wheel is apparently at a neutral position, it is 
unkrK>wn whether or no4 the wheels are oriented for a 
straight drive. Further, visibility is limited in the backward 
area erf the vehicle, so that the driver takes much care 
when he backs the vehk^le into a narrow space. 
[0004] Particularly, the paricing technique is one of the 
most difficult driving techniques when a normal driver 
drives a vehicle. In parking the vehicle, the driver must 
steer the vehicle so that the vehicle moves into a r^rrow 
parking space without touching of his car with another 
vehicle or an obstructive object or without being mired 
in a ditch. The obstructive object and the other vehicle 
which the vehfcle driven by the driver may touch usually 
exist in an area existing within a dead angle when 
viewed from the driver. Accordhgly, the driver must 
steer the vehicle while exactly grasping relative position- 
al relationship of the vehicle body to other objects. 
[0005] IN the technique to pfiu-k the vehicle, particul- 
raly, particular the technque to park the vehicle in a 
parking space between the adjacent vehicles of those 
being parked in a row in a back-to-front fashion <this 
parking will be referred to as a 'series parking") is one 
of the most difficult driving techniques when a normal 
driver drives the vehk:le. In the series partcing, the driver 
must back the vehicle into a narrow parking space and 



reversely turns the steering wheel. Further, since the 
driver backs the vehtele, a parking space in which the 
vehkile is to be parked is the dead space when viewed 
from the driver and the driver insufficiently knows the 
5 environment around the parking space. In this state, the 
driver must parks the vehicle ri the parking space 
[OOOq A drive assist technique in whfch when the ve- 
hfcle is moved backward, it is disclosed in JP-A- 1 -1 4700 
that an image of the backward or sideward area of the 
^0 vehble arxf a predictive traveling path curve are dis- 
played. In the background technique, a predictive 
traveling path of the vehicle, which is predated depend- 
ing on a steerhg angle in the vehicle, is laid over an 
image of the backward area of the vehfcle. Therefore, 
the driver can check both the steering angle of the steer- 
ing wheel and safety in the driving in the backward area. 
According to the drive assistance of JP-A-1 -14700. a 
steering angle of a steering wheel is detected by a steer- 
ing sensor, a predk^ive traveling path corresponding to 
^ a steering angle of the steering wheel when the vehicle 
backs is overteid on the image picked up by the camera* 
and frames are depicted in a state that those eire equi- 
distant ly arrayed atong the predrctive traveling path or 
a simplified vehicle is depicted, whereby the driver eas- 
2S iiy understands in sense the predctive traveling path. 
[0007] A drive assist technkjue whteh detects a length 
of a parking space by vartous sensors, and assists the 
driver in his paricing by use of the detection result, is 
disclosed in JP-A-7-44799. According to JP-A-7-44799. 
30 when the vehicle passes the skie of a series parking 
space, the vehicle parking assist devk^e measures the 
parking space, and cateulates an airwunt of steering op- 
eratkxi. a time of depressing the accelerator or a time 
of depressing a brake pedal by using the parking space 
55 informatk>n measured and vehk;le information, and 
gukJes the driver for the series parking. 
[0008] A drive assist technfc|ue for assisting the driver 
in his driving by use of an image produced by picking 
up a scene around the vehfcle is disclosed in JP-A- 
10-283592, JP-A-1 0-257482, JP-A-6-265423. JP-A- 
239400. JP-A-5-1 43894. JP-A-7-192199, and JP-A- 
57-150044U. 

[0009] According to JP-A-1 0-283592. based on three 
dimensk>nal analysis of an snage picked up by a cam- 
era, it is judges whether or not the self vehfcle touches 
an obstructive object, and the driver is informed of the 
judgement result while at the same time displays a re- 
lation between the self vehkJe and the obstructive ob- 
ject. 

[0010] JP-A-10-257482 disck)ses the drive assist 
technique which seamlessly composes an image of the 
backward area of the vehkHe. an image of the left side 
of the vehrcle, and an image of the right skie of the same, 
and displays the composed inrtage. 
[0011] JP-A-6-255423 discloses a drive assist tech- 
nique whfeh displays an umage picked up by a camera 
together with a distance scale for the drive assist. 
[0012] JP-A-4-23940 disctoses a drive assist tech- 
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nique in which a camera, which may be horizontally 
turned over a range of 360*, is attached to the celling of 
the vehicle with the aid of a tumtabte. a scene in areas 
existing in desired directions around the vehble are 
picked up by the camera, and the images thus picked 
up are converted and composed for ease of watching 
by the driver, and the resultant bmage is used tor drive 
assist 

[0013] JP-A-5-14389 disctoses a drive assist tech- 
nique in whbh scenes of the areas in the front left, front 
and front right of the vehicle are picked up by three cam- 
eras, arxJ varies the segmental display areas or win- 
dows of the screen on which the images from the three 
cameras are displayed, thereby effecting the drive as- 
sist 

[0014] JP-A-7-19219 disctoses a drive assist tech- 
nique in whk;h when the vehicle passes though a narrow 
road, an obstructive object is detected from an image 
produced by picking up a scene of the frontward area, 
and a gap between it and the obstructive object, thereby 
effecting the drive assist. 

[001 S] JP-A-57-150044U discloses a drive assist 
technk^ue in which when an abnormality occurs, the 
contents of a display by a display device is changed from 
the display contents for a normal mode to the display 
contents lor a normal mode, thereby effecting the drive 
assist 

[001 6] However, as in the drive assist technique of JP- 
A-7 -44799. a length of the parking space is estimated 
on the basis of a detected distance, arxi the drive assist 
is carried out for a garage paridhg and a series parkfing. 
In the technique, an image of the dead space tor the 
driver is not displayed for the drive assist. Therefore, the 
technk|ue fails to completely remove an anxiety of the 
driver. 

[0017] In the background art of the JP-A-64-4700, a 
three-dimerwional display along a predictive traveling 
path is used for enhancing the illusion of depth of a pre- 
dictive traveling path image. The technique to merely 
display 3-dimensfonal Rnages equidistantly arrayed 
along the traveling path predated on the basis of a steer- 
ing angle or nnove them akxig the traveling path is al- 
nfK>st Ineffective in checking a possibility that the vehicle 
will touch an obstructive object located near the predic- 
tive traveling path, because the driver must judge 
whether or not a steering angle of the steering wheel is 
proper. 

[0018] Moreover, the information display device for 
displaying the inrages, usually installed to the vehicle, 
must be mounted in a narrow space near the driver seat. 
Therefore, the screen of the intormallon dfeplay device 
is not large. For this reason, when the driver watches 
the display contatntng the backward area and the pre- 
dictive traveling path curve, and judges if the predictive 
traveling path is proper, it is difficult for the driver to ex- 
actly judge if the predictive traveling path is proper. 
[0019] Where the technique, as disclosed in JP-A- 
7-44799, (o merely make an exact measurement of the 



partying space is used, it enables the drive to check if 
the parking space is sufficiently large, but it can unsat- 
isfactorily assist the driver in the driving operatk>n. which 
is necessary for the advancing of the vehicle to the pari<- 

5 ing space. The publk^tton of JP-A-7-44799 describes 
in detail the measurement of the parking space, and re- 
fers to only the instructions of the driving operatfons for 
parking that is given to the driver. However, specific in- 
structrans are unclear in the description of the publica- 

w tk>n. 

[0020] The partcing assist technique, as disctosed h 
JP-A-1 0-283592, which merely judges if the self vehicle 
touches the obstructive object from the three-dimen- 
sional analysis of the image, fails to effect such a parking 
assist as gukie the vehcle to a predetermined parking 
space. 

[0021] On summarizing the above, in the drive assist 
technkjue in which the image picked up by the camera 
is used for the drive assist, an image of the dead space 
for the driver is used for watching the dead space. 
Therefore, the driver may check the environment con- 
ditions arourxJ the vehk;le by watching the image, and 
the driver may take a feeling of security. However, those 
related techniques do not always provide proper drive 
guide information havrtg a simple construction. 

SUMMARY OF THE INVENTION 

[0022] Accordingly, an object of the present invention 
to provide a vehk:te parking assist devtoe which assists 
the driver in his driving, using a simple image display or 
simple voice system. 

[0023] According to the present inventbn. there is 
provbed a vehfcle drive assist system comprising; 

a camera for picking up an image of an area existing 
ri the advancing directkm of a vehicle; 
display means for displaying an tmage picked up by 
the camera; 

steering angle detecting means for detecting a 
steering angle for steering a vehicle; 
traveling path predicting means for pred toting a 
traveling path of a vehicle on the basis of a steering 
angle detected by the steering angle detecting 
means; and 

drive assist means for overiaying drive assist infor- 
matton containing a vehtole predictive traveling path 
predtoted by the traveling path predicting means 
and gukie Ires prolonged from the Iries defining 
the width of the vehicle body on the image of the 
area existing in the vehtole advancing direction, 
which is displayed by the display means. 

[0024] In the inventkxi. a vehtole predtotive traveling 
path predicted on the basis of a steering angle of the 
vehtole and guide lines protonged from the lines defining 
the width of the vehicle t>ody are overlaid on the image 
of the area existing in the vehicle advancing direction, 
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which IS displayed by the display means, for example. 
^ Therefore, the vehicle parking assist device appropri- 
ately compensates for the lack of the visual sensation 
in the vehkile drive. 

[0025] In the vehicle drive assist device, the drive as- 
sist nneans selects a display of the predictive traveling 
path and/or guide lines. 

[0026] The invention selects a display of the predic- 
tive traveling path and/or guide lines. Therefore, the im- 
age from the camera and the predictive traveling path 
curve or one of the gurcie lines, or that image, the pre- 
dictive traveling path curve and the gukJe lines are dis- 
played, thereby performing a proper drive assist. 
[0027] In the vehicle parking assist device, the drive 
assist means varies a brightness of a display of the pre- 
dictive traveling path and/or gukie lines in accordance 
with a brightness of the environment. 
[0028] In the inventbn. a brightness of a display of the 
predictive traveling path artd/or guide lines may be var- 
ied in accordartce with a brightness of the environment. 
[0029} In the vehrcle drive assist device, the drive as- 
sist means varies a cotor arrangement of a display of 
the predictive traveling path andtor guide lines in ac 
cordanco with a cotor arrangement of the environment. 
[0030] In the inventk>n. a color arrangement o1 a dis- 
play of the predictive traveling path is varied in accord- 
ance with a color arrangement of the environment. 
Therefore, an easy-to-understand guide display is pre- 
sented to the driver, whereby a proper drive assist is per- 
formed. 

[0031] In the vehicle drive assist devtee. the vehcle 
includes a brightness sensor for sensing a brightness of 
the environment to select an illumination system, and 
the drive assist means varies a brightness or a cokx ar- 
rangement of a display of the predictive traveling path 
and/or gukJe lines in accordance with a brightness 
sensed by the brightness sensor. 
[0032] In the invention, a brightness sensor attached 
to the vehicle senses a brightness of the environment, 
and a brightness or a color arrangement of a display of 
the predictive traveling path and/or gukie linos is varied 
in accordance with a color arrangement of the environ- 
ment. Therefore, a display whk^ is easy for the driver 
to understand is automatically performed. 
[0033] In the vehicle drive assist device, the drive as- 
sist means varies a cokx arrangement of a display of 
the predictive traveling path and/or guide lines in ac- 
cordance with a background color of an image pk^ked 
up by the camera. 

[0034] In the invention, a color arrangement of a dis- 
play of the predfotive traveling path and/or guide lines 
is varied in accordarx:e with a background color of an 
Image picked up by the camera. With this feature, when 
the background color is bright, the predictive traveling 
path curve and the guide lines may be displayed using 
a dark cotor. When the background color is dark, the lat- 
ter displayed may be bright in cotor Therefore, an easy- 
to-understand drive assist may be presented to the driv- 
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[0035] In the vehicle drive assist devfce, saW drive as- 
sist means includes 

5 parking drive judging mearw for judging whether or 
not the drive of the vehicle is a parking drive, 
parking end judging means ananged such that 
when sakj parking drive judging means judges that 
the vehicle drive is a parking drive, said parkrig end 

10 judging means judges whether ornot the parking 
drive ends. 

storing means arranged such that when saki park- 
ing end judging means judges that the parking drive 
ends, saki storing means stores a select condition 
IS for displaying said predk:tive traveling path andtor 
gukle lines, and 

select means arranged such that whan saki parking 
drive judging means judges that the vehtole drive is 
a parking drive, sard select rr^arrs selects a display 
^ condition ot saki drive assist infonrotton in accorxi- 
ance with the contents of said storing means. 

[0036] In the invention, the final display conditton at 
the erKi of the parking assist is stored, and when the 

25 next part<ing drive is performed, the display condition is 
changed to the stored one. Therefore, there is eliminat- 
ed the work by the driver to change the display conditton 
to another. The parking assist is carried out with a dis- 
play which is easy for the driver to understand. 

30 [0037] In the vehicle drive assist device, saki camera 
ptoks up an Image by a wide angle field, and saki drive 
assist displays sato gutoe lines curved in accordance 
with a distortion of a wide angle image pk;ked up by saki 
camera. 

OS [0038] In the invention, said guide lines, when dis- 
played, are curved in accordance with a distortton of a 
wide angle in^age pfcked up by saki camera. Therefore, 
the gukJe lines exactly correspond to the lines respec- 
tively protonged from the lines defining the width of the 
vehk:le body. 

[0039] In the vehtole drive assist devtoe. the drive as- 
sist mear^ displays the predictive traveling path andtor 
guWe lines except the portions thereof near the vehfcle. 
[0040] In the inventton, in displaying the predtotive 
^ traveling path curve an6 the gukJe lines, the vehicle 
body is present on this skle of them in the regton near 
the vehicle. Therefore, the width is not coinckient with 
the back wkith of the vehicle apparently. In the invention, 
the non-coirxiident portion is not displayed, and the driv- 
^ ing for this portfon depends on the driver's judgement, 
whereby an unnatural display is avoided. 
[0041] In the vehtole drive assist devk:e, the drive as- 
sist means displays the predictive traveling path andfor 
gukie lines such that the poritons thereof near the vehi- 
55 cle are broadened. 

[0042] In the invention, portions of the predtotive 
traveling path and/or guklo lines, which are near the ve- 
hk;le. are broadened. Therefore, a safety is secured. 
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[0043] In the vehicte drive assist device, the drive as- 
sist means displays a line Indicative erf a stop position 
o1 the vehicle at a position on the predictive traveling 
path and/or guide lines a line indicative of a stop position 
ol the vehicle, which is located near the vehicle. 
[0044] In the invention, a line indicative of a stop po- 
sition of the vehicle is displayed at a position on the pre- 
dictive traveling path or the guide lines, which is located 
nearthe vehicle. Therefore, an easy parking drive assist 
is secured in a manner that when the moving vehicle 
frame reaches the stop line, the vehicle is stopped. 
[0045] In the vehicle drive assist device, the drive as- 
sist displays the guide lines when braking is effected. 
[0046] In the inventfon, when the driver operates the 
brake, the guide lines are displayed. Therefore, when 
the operator operates the brake and checks if the pre- 
dictive traveling path is parallel to the gukJe lines, and 
when the traveling path is parallel to the guide lines, the 
steering wheel is at the center posltioa 
[0047] In the vehicte drive assist device, the drive as- 
sist displays the gukJe lines in the fomn of dotted lines. 
[0048] In the invention, the guide lines are displayed 
by dotted lines. Therefore, the guide lines may be made 
unnoticeable. When the predkjtive traveling path is ad- 
ditionally displayed, the predictive traveling path is in- 
tensified in brightness on display Accordingly, the drive 
guide with a mariced disptay of the predfctive traveling 
path is presented to the driver. 

[0049) The vehicle drive assist device further com- 
prises an obstacle sensor for detecting presence or ab- 
ser>ce of an obstructwe object on a vehicle traveling 
path, and wherein the drive assist varies a length of the 
guide lines in accofdance with a distance ranging to an 
obstructive object detected by the obstacle sensor. 
[0050] In the inventk>n, a length of the guWe lines is 
varied in accordance with a distance ranging to an ob- 
structive object detected by the obstacle sensor, such 
as a back sonar. Therefore, the display gives the driyer 
a drive feeling resembling an actual driving feeling. A 
driver assist whk^ is easy for the driver to understand 
is provided. 

[0051] In the vehicte drive assist device, the drive as- 
sist means displays the gukJe lines in a state that the 
width of the guide lines, when displayed, is wkfer than 
the width of the vehble. 

[0052] In the invention, the width (rf the gukte lines dis- 
played is wkier than the width of the vehicle. Therefore, 
the drive assist is carried out with an easy-to-handle op- 
eratfcn. For example, when one of the gukie lines lies 
on one skJe of the parking frame, the driver retums the 
steering wheel to the center positfon. 
[0053] According to the present invention, there is 
provided a vehicle drive assist system comprising; 

a camera for picking up an image of an area existing 
In the advancing direction of a vehicle; 
display means for displaying an image picked up by 
the camera; 



reverse gear mode detecting means for detecting 
as to whether or rK>t a transmission of the vehicte is 
set to a reverse gear mode; and 
drive assist means arranged such that when the ro- 

5 verse gear mode detecting means judges that the 
transmissbn is set to the reverse gear mode, the 
drive assist means changes a display by the display 
means and informs the driver that the transmission 
is in a reverse gear mode, thereby effecting the 

JO drive assist. 

[00S4] VSnien the transmis8k>n is set to the reverse 
gear mode, a display by the display means changes. 
The driver is rifonmed of the transmissk)n being in a re- 
is verse gear mode. Therefore, an acckient which will oc- 
cur when a gear position of the transmission has slipped 
from the driver's memory can be prevented. 
[0055] According to the present invention, there is 
provided a vehicle drive assist system comprising; 

a camera for picking up an image of an area existing 
in the advancing direction of a vehicle; 
display means for displaying an image picked up by 
the camera; 

^ an obstacle sensor for detecting presence or ab- 
sence of an obstructive object in a t>ackward area 
of the vehicte; 

drive assist nneans arranged such that when an ob- 
structive object is detected by the obstacte sensor. 
30 the drive assist means informs the driver of pres- 
ence of an obstructive object by changing a display 
by the display means. 

[0056] In the invention, when an obstructive object is 
^ detected by the obstacle sensor such as a back sonar 
or comer sensors, a display by the display means is 
changed to inform the driver of the presence of the ob- 
structive object. The display calls the driver's attention 
to the obstructive object, thereby preventing the vehicte 
40 from touching th e obstruct ive object 

[0057] In the vehicle drive assist device, the drive as- 
sist means displays infomnation in the form of character 
tetep for the drive assist. 

[0058] In the invention, the drive assist infornnation is 
^ displayed in the form of character tetop. Therefore, driv- 
er's attentkxi is reliably called to avoid a dangerous ac- 
cident. 

[0059] In the vehicle drive assist device, the drive as- 
sfet nr>eans displays information in the form of a color 
^ change of the entire display. 

[0060] Thus, driver's atlentten Is attracted by a cokx 
change of the entire display. 

[0061] According to the present invention, there is 
provided a vehtete drive assist system comprising; 

55 

a camera for picking up an Image of an area existing 

in the advancing directten of a vehfcle; 

display mear>s for displaying an image picked up by 
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the camera; 

drive assist means arranged such that the drive as- 
sist means detects a drive condition and judges 
whether or not the drive mode is a parking drive 
mode, and when the drive mode is a parking drive 
mode» Ihe drive assist means causes saki display 
means to display an image display of the display 
means and an image display for parking drive as- 
sist; and 

safety check means for dispteying a tebp to urge 
the driver to make a safety check on the image for 
the parking drive assist by the drive assist mearts. 

[0062] In the invention, when the drive nxxJe is a park- 
ing drive mode, the image for the parking assist and a 
telop for urging the driver to make a safety check by the 
eye are displayed. Therefore, it is prevented that the 
driver is riveted to the display by the display means. 
[0063] According to the present invention, there is 
provided a vehtele paricing assist devfce comprising: 

a camera for picking up an image of a backward 
area of a vehicle; 

display means for displaying an image picked up by 
the camera; 

obstacle sensor tor detecting presence or absence 
of an obstacle in the backward area of the vehicle; 
drive assist means arranged such that the drive as- 
sist detects a drive condition and checks if the ve- 
hicle backs for parking, and when the vehicle backs, 
the drive assist nr^eans displays drive assist infor- 
mation for parking; and 

safety check means arranged such that the safety 
clneck means checks the parking drive ends on the 
basis of the result of the obstacle detection by the 
obstacle sensor, and when the parking drive ends, 
the safety check means causes the display means 
to display the end of the pariahg drive. 

[0064] In the r(ventk>n, the safety check means 
checks the parking drive ends on the basis of the result 
of the obstacle detection by the obstacle sensor, such 
as a back sonar, and when the parking drive ends, a 
display of the end of the parking drive is presented on 
the screen of the display means. 
[0066] According to the present invention, there is 
provided a vehicle parking assist devk:e comprising: 

a camera for picking up an image of a backward 
area of a vehicle; 

display means for displaying an image picked up by 
the camera; 

reverse gear mode detecting means for judging 
transmission of the vehk;le is set to a reverse gear 
mode; and 

drive assist means arranged such that when the re- 
verse gear nrKxJe detecting means judges that the 
transmission is set to the reverse gear mode, the 



drive assist means limits a speed of the vehicle to 
the preset upper limit of the vehicle speed or lower, 
thereby effecting the drive assist, 

5 [0066] In the inventkxi. when the vehicle is moving 
backward, a speed of the vehicle is limited to the preset 
upper limit of the vehicle speed or tower. 
Therefore, collision of the vehicle when it is moved back- 
ward is prevented or shock when the collision occurs is 

10 lessened. 

[0067] According to the present invention, there is 
provided a vehicle parking assist device comprising: 

a camera for pteking up an mage of a backward 
area of a vehicle; 

display means for displaying an image pk:ked up by 
the camera; 

obstacle sensor for sensing presence or absence 
of an obstacle in the backward area of the vehicle; 
^ and 

drive assist nrteans arranged such that when the ob- 
stacle sensor detects an obstacle, the drive assist 
means limits a speed of the vehicle to the preset 
upper limit of the vehicle speed or tower, thereby 
25 effecting the drive assist. 

[0068] In the inventton. when the obstacle sensor de- 
tects an obstacle such as a back soar, the drive assist 
means limits a speed of the vehicle to the preset upper 
3o limit of the vehicle speed or tower Therefore, colliston 
of the vehfcle when it is moved backward is prevented 
or shock when the colliston occurs Is lessened. 
[0069] According to the present invention, there is 
provtoed an vehicle parking assist device comprising: 

35 

a camera for ptoking up an mnage of a backward 
area of a vehicle; 

display means tor displaying an image picked up by 
saki camera; 

^ reverse gear nrKxie detecting means for judging 
transmisston of the vehicle is set to a reverse gear 
mode; and drive assist means arranged such that 
when said reverse gear mode detecting means 
judges that the transmission is set to the reverse 

^ gear mode, said drive assist n^eans changes an il- 
luminatton directton of a lamp illuminating a back- 
ward area of the vehicle, thereby effecting the drive 
assist. 

[0070] When the transmission is set to the reverse 
gear n>ode, the drive assist nrteans changes an illumi- 
natton direction of a larr^ illuminating a backward area 
of the vehicle, thereby effecting the drive assist. There- 
fore, even vifhen the parking tot is dark at night, for ex- 
55 ample, the image picked up by the camera is increased 
in brightness, and hence an easy-to-understand drive 
assist is secured. 

[0071] A vehicle drive assist device, wherein the lamp 
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is optionally installed. 

[0072] , In the Invention^ the lamp tor illunninating a vis- 
ual field of the camera when the vehicle backs is option- 
ally attached to the device. Therefore, good visibility is 
secured in the parking drive at night, for example. 
[0073] In the vehicle drive assist devk^, the vehicle 
is equ^ed with a car-carried device including a navi- 
gation devkJe and/or audio device, and further the de- 
vice comprises select means for causing the display 
means to selectively display the image from the camera 
and the image from the drive assist means or the image 
from the car-carried device. 

[0074!] In the invention, the image from the camera 
and the image from the drive assist means or the innage 
from the car-carried devk:e, e.g., a navigation device or 
an audio device, may be selectively displayed when re- 
quired in the driving. 

[0075] According to the present invention, there is 
provided a vehicle parkhg assist devrce comprising: 

a camera tor picking up an image of an area existing 
in a vehicle; 

display means for displaying an image picked up by 
the camera; artd 

drive assist means for switching drive assist infor- 
mation for paf1<ing overlaid on an inr>age displayed 
by the display means between the drive assist in- 
formation of a normal parking mode and that of a 
series parking mode. 

[007S] Drive assist means for switching drive assist 
informatics for parkrig may be switched between the 
drive assist information of a normal parking mode and 
tiial of a series parking mode in accordance with a nor- 
mal parking or a series parking. 

[0077] In the vehicle drive assist device, the drive as- 
sist means selects the drive assist nnformatlon of a se- 
ries parking mode when the tumrig on of a winker lamp 
or a hazard lamp and the shifting of the transmissfon to 
the reverse gear mode are simultaneously performed. 
[0078] In the invention, a display mode of the display 
means is changed to a series parking mode in whkih the 
display means displays the drive assist infomretkw for 
the series parking, in accordance with a lighting condi- 
tion of the winker lamp or hazard lamp. 
[0079] In the vehicle drive assist devk?e. the vehcle 
is equipped with a navigation device, and the drive as- 
sist means arranged such thai the drive assist means 
judges whether a parking positk>n in which the vehtele 
is to be partted is In a parking k>t or on a road, on the 
basis of the present posltk>n of the vehicle derived from 
the navigation device, and when the parking positk>n is 
in the parking lot. the drive assist means selects the 
drive assist rifomnatk>n of the normal parking rrK>de, and 
when the parking positk^n is on the road, the drive assist 
means selects the drive assist fnformatkjn of the series 
parking mode. 

[0(^] I n the invention, the drive assist means judges 



whether a parking position in which the vehicle is to be 
pari<ed is in a parking tot or on a road, on the basis of 
the present position of the vehicte derived from the nav- 
igation devrce. When the parking position is in the park- 
5 ing lot, the normal parking mode is selected, and 

when the parking position is on the road, the series park- 
ing mode is selected. 

[0081] In the vehble drive assist devk:e. the drive as- 
sist means selects the drive assist information of the 
10 norrml parking mode or the series parking mode in ac- 
cordance with a change of a steering angle for steering 
the vehicle. 

[0082] In the inventton. the normal parking mode or 
the series parking mode is selected in accordance with 

'5 a change of a steering angle for steering the vehicle. 
Therefore, the seriee parking irKluding a reverse turn 
the steeroig wheel or the normal nrxx^e rxst including the 
steering reverse tum may be automatbally selected. 
[0^9] According to the present inventton. there is 

^ provided a vehfcle f>arklng assist device comprising: 

a plurality of cameras being disposed such that the 
photographing areas covered by the cameras are 
shifted so as to pbk up a scene around the vehicte; 
25 display means for displaying images pfcked up by 
the cameras; and 

drive assist means arrar>ged such that a display 
screen of the display means is segmented into plu- 
rality of display areas. arxJ the images by the plu- 
30 ratify of cetmeras are simultaneously displayed on 
those segmental display areas, thereby effecting 
the drive assist. 

[0034] In the invention, a plurality of cameras are dis- 

^ posed such that the photographing areas covered by the 
cameras are shifted so as to pick up a scene around the 
vehicle. A display screen c* the display means is seg- 
mented into plurality of segmental display areas in ac- 
cord^ce wrth the arrangement of the cameras. The im- 

40 ages by the plurality of cameras are SBnultaneously dis- 
played on those segmental display areas. Therefore, 
the driver may kx>k a plurality of images on the same 
screen of the display means. Accordingly, the driver may 
drive the vehcle while watching the irmges of the broad 

4S ang u lar expanse . 

[0085] In the vehrcle drive assist, further comprising 
drive condition detecting means for detect rig a vehicte 
drive condition, and wherein the drive assist means se- 
lectively changes a display in accordance with a drive 

5o condition detected by the drive conditton detecting 
means. 

[0086] In the invention, a display on the screen is 
changed in accordance with a drive conditton. Accord- 
ingly, the drive assist is carried out by use of a display 
55 of visual infonmtion whbh is easily understood by the 
driver since an atiage display by the display means is 
automatically changed In accordance with vehicle run- 
ning conditions. In a specif to example, in the normal run- 
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ning, two images of the front left and right areas of the 
vehicle are displayed, and in the backward running, 
three innages of the front left and right areas, and the 
bactcward area are displayed. 

[OCfflT] The vehicle drive assist device further com- 
prises drive corxJition detecting means for detecting a 
vehicle drive condition, and wherein the drive assist 
means selectively changes a display in accordance with 
a drive condition detected by the drive condition detect- 
ing means. 

[0088] In the nvention. the vehicle is displayed in a 
stmplffied form on the screen of the display means. 
[0(^9] Accordingly, a relationship of the image rela- 
tive to the vehicle is displayed ri an easy-to-understand 
manner on the basis of the displays of the vehicle an the 
innage. whereby a proper drive assist is provided to the 
driver. 

[0(^] I n the vehicle drive assist devfce. the drive as- 
sist nrteans moves a display position of the vehicle ac- 
cording to an image from the camera 
[00911] Since a display position of the vehicle is moved 
in accordance with an irr^ge from the camera, a change 
of the image display is easy to urxJerstand. 
[OC^] I n the vehicle drive assist device, the drive as- 
sist means operates to display the directions and pho- 
tographing areas covered by the cameras when the ve- 
hicle is displayed in a simplified form. 
[0093] In the invention, the vehicle is displayed ina 
simplified form, and the directions and photographing 
areas covered by the cameras are also displayed. 
Therefore, the driver easily recognizes which camera 
picked up the bnage being disp^yed. 
[OCmi In the vehicle drive assist device, the vehicle 
is equipped with a car-carried device including a navi- 
gation device and/or audio device, and drive assist 
means arranged such that a display screen of the dis- 
play means is segmented into plurality of display areas, 
and the images from the plu rality of cameras and an im- 
age from the car-carried device are displayed on those 
segmental display areas, thereby effecting the drive as- 
sist. 

IQOBSl In the invention, the driver may kx»k both the 
image by each camera and the image by the navigation 
devbe or the audio device on the same display screen. 
[009S] In a vehicle drive assist device, drive assist 
means changes the cameras, which causes the display 
means to dispby, one to another at predetemnined time 
intervals. 

[0(^7] In the invention, the images by the plurality of 
cameras are changed one to another at predetermined 
time Intervals, to thereby eliminate the manual work of 
the driver to change the images. 
[0(^] In the vehksle drive assist device, the drive as- 
sist means uses a wpe to change the images. 
[OC^] In the inventkm. the wipe is used for changing 
the Images by the plurality of cameras one to another 
The shifting of one image to another Image is continu- 
ous. Further, the changing of the images is automatically 



performed without the manual operation by the driver. 
[0100] In the vehicle drive assist device, a camera for 
pfcking up a scene of a skie area of the vehicle is includ- 
ed in the cameras, and the drive assist means operates 
5 to display a skJe image concemhg a directkxi indicator, 
whk^ is operated being interconnected with an opera- 
tk>n of the direction Indicator. 

[0101] In the inventk>n. the onage of the area existing 
in the vehk^e advancing direction may be displayed be- 

10 ing interconnected with the direction operation. Accord- 
ingly, the vehk;le pari<ing assist devk^e effectively as- 
sists the driver to make a safety check. 
[0102] In the vehble drive assist devk^e. the drive as- 
sist means changes the rnages one to another in ac- 

'5 cordance with a steering angle of tum of a steering 
wheel for steering the vehk^le. 

[0103] In the invention, the images are changed one 
to another in accordance with a steering angle of tum of 
a steering wheel. Therefore, the image erf the area ex- 
^ isting in the vehicle advancing direction Is automatteally 
displayed, and the device assists the driver safely and 
effectively. 

[0104] In the vehk;le drive assist device, the drive as- 
sist means changes a condition df segmenting the 
25 screen of the display means in accordance with a steer- 
ing angle of the steering wheel. 

[0105] In the invent kxi. the screen segmenting condi- 
tkxi is changed in accorc^nce with a steering angle 
the steering wheel. Therefore, the image of the area to- 
30 cated in the advancing direction is displayed on a wkie 
display screen, and a safety check is easy in the drive 
assist. 

[01 08] The vehrcle drive assist devbe further includes 
conprising an obstacle sensor for detecting presence 
35 or absence of an obstructive object on a vehicle 
traveling path, and wherein when the obstacle sensor 
detects an obstacle, the drive assist means causes the 
display means to display a sensing direction of the ob- 
stacle sensor. 

40 [0107] In the inventk>n, wherein v^en the obstacle 
sensor detects an obstacle, a sensing directk>n of the 
obstacle sensor is displayed. Therefore, the device in- 
forms the driver of a relatk>n of the vehtele to the ob- 
structive object on the display screen to attract the driv- 

4S er*s attentron. 

[0108] In the vehicle drive assist devrce. when the ob- 
stacle sensor detects an obstacle, the drive assist 
means causes the display means to display an image 
from the camera which pbks up a sensing directk^ of 

50 the ot>stacle sensor. 

[0109] In the invention, when the obstacle sensor, e. 
g.. a comer sensor, detects an obstacle, an image in- 
cluding the obstacle is displayed. The vehicle parking 
assist devk;e calls driver's attention to the presence of 

55 the obstacle and its state. 

[0110] In the vehicle drive assist device, when the ob- 
stacle sensor detects an obstacle, the drive assist 
means causes the display means to shift a display po- 
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sition of an image, which comes from the camera which 
^ picks up a ser^sing direction the obstacle sensor, to 
the center of the screen of the display nneans or to ex- 
pand the display. 

[Oltl] In the invention, while being Diterconnected 
with the obstacle sensor, e.g., a comer sensor, a display 
position of an image, which comes from the camera 
which picks up a sensing directwn of the obstacle sen- 
sor, is shifted lo the center of the screen of the display 
means or the display is expantted. Therefore, the pres- 
ence of the obstacle and its state are displayed in an 
ease-to-understand manner. 

[01112] In the vehfcle drive assist device, the drive as- 
sist means causes the disp^y nrteans to overlay an 
alarm on a display of the sensing direction of the obsta- 
cle sensor. 

[01113] In the invention, while being interconnected 
with the obstacle sensor, such as a corner sensor, an 
aiamn is overlaid on a display of the sensing direction of 
the obstacle sensor. Therefore, the driver is cntelligibly 
informed of the direct k>n in whk;h the obstacle is con- 
tained, which is easy to understand. 
[Oil 4] In the vehicle drive assist device, when the im- 
ages of the cameras adjacently disposed are simulta- 
neous^ displayed, the drive assist means adjusts the 
disp^y areas and positions of those images so that 
those images are continuously connected together. 
[01 1 S] In the invention, the images by the cameras ad- 
jacently disposed are continuously connected together 
to form a single composed image. With the composed 
irr^ge, the image covering an expanse of area, which 
is easy for the driver to understand, is piovided to the 
driver, to thereby support the driving. 
[OIIG] In the vehicle drive assist device, the camera 
are disposed so as to take scenes of the front, front left, 
front right, rear left and rear right areas of the vehicle. 
[Oltrj The vehicle parking assist devfce of the inven- 
tion is capable of photographing the entire circumferen- 
tial area around the vehk^le. 

[01 1 8| In the vehicle drive assist device^ the drive as- 
sist means segments the screen of the display means 
into the upper arxf k>wer display areas, and causes the 
display nr^ns to display an Image of the frxxit of the 
vehicle on the central area of the upper display area of 
the screen, the front left and right hnages on the left and 
right display areas of the upper display area, and an im- 
age of the rear area of the vehicle on the central area of 
the tower display area of the screen, the rear left and 
right irreges on the left and right areas of the tower dis- 
play area of the screen <rf the display means, 
[om 9] The vehicle parking assist devtee of the inven- 
tion is capable <^ making a safety check on the entire 
circumferential area around the vehicle on one display. 
[0120] In the vehicle drive assist device, the drive as- 
sist means causes the display means to display an im- 
age selected from Inriages picked up by the cameras dis- 
posed described above. 

[0121) J Only the image, which is selected, as needed. 



from images picked up by the cameras so disposed as 
to pick up the entire circumferential area around the ve- 
hicle, is displayed. Accordingly, the display means is ef- 
ftciently utilized to display a necessary image. 

s [01 22] In the vehk^le drive assist device, the drive as- 
sist means causes the display means to display the im- 
ages output from the cameras havng the photographing 
areas successively disposed in scrolling manner. 
[0123] The images output from the cameras having 

10 the photographing areas successively disposed are 
scrolled into a single image. Therefore, the driver is able 
to readily check the inrtage of a broad area around the 
vehfele. 

[0124] In the vehicle drive assist device, the display 
means includes a touch panel, and the drive assist 
means changes an image display condition according 
to an input to the touch panel. 

[0125] The display means for displaying an image 
picked up by a plurality of cameras is equipped with a 
touch panel. Tberefore. the driver nriay change a display 
condition of an image by merely touching the touch pan- 
el. 

[0126] In the vehicle drive assist devrce, according to 
an input to the touch panel, the drive assist means dis- 
25 plays an image at a posit ton as input in a state that a 
time axis of its disptey is extended, and after a prede- 
termined time elapses, the drive assist means retums 
the extended time axis to the original one. 
[0127] In the invention, when the driver touches the 
touch panel to enlarge the image, the image resumes 
its original size after a predetermined time elapses. 
Therefore, the manual operation work is lessened to 
provide an effective drive assist. 

[0128] According to the present invent kxt, there is 
^ provided a vehicle parking assist device comprising: 

a camera for ptoking up a scene in a frontward area 
of a vehtole; 

storing means for readingan irrage picked up by the 
^ camera into the storing means per se; and 

drive assist means for acquiring informatton for ve- 
hicle drive assist on the basis of the image stored 
n the storing means. 

45 [0129] In the invention, a canrkera picks up a scene in 
a frontward area of a vehtole» and storing mearw reads 
an image picked up by the camera into the storing 
means per ee. Since the inriage is stored into the storing 
means ri the form of vehicle drive assist information, the 

so driver can readily extract the inr>age as infomretion ef- 
fective for drive assist. The san>e Information may be 
transmitted to other devices, and the informatton may 
be used as the informatton for congestion in broad are- 
as. 

55 [0130] The vehtole drive assist device further com- 
prises display means for displaying an image coming 
from the camera. 

[0131] Since an image coming from the camera is dis- 
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played by the display means, the driver can check a 
, f rontwaxd area of the vehicle by the dispby means. 
[0132] The vehicle drive assist device further com- 
prises vehicle detecting means for detecting a vehicle 
forcibly ninning Into a place in front of a self vehicle by s 
processing the image coming from said camera. 
[0133] In the invention, a vehicle forcibly running into 
a place in front of a self vehicle is detected by processing 
the image coming from said camera. Therefore, the ve- 
hicle drive assist device effectively effects the drive as- io 
sist of, for example, measuring a distance from the self 
vehicle to the preceding vehicle. 
[01341 According to the invention, there is provided a 
vehicle parkhg assist device comprising: 

15 

a camera, attached to the top oC a vehicle, for pick- 
ing up a scene around a vehicle as viewed from the 
top of the vehicle; 

display means for displaying the image picked up 
by the camera; and 20 
drive assist means arranged such that the drive as- 
sist means detect a limit of a vehicle height from the 
innage picked up by the camera, and Biforms a driv- 
er of the detection result as drive assist infomriation. 

25 

[0135] In the invention, a camera is attached to the 
top of a vehicle and picks up a scene around a vehicle 
as viewed from the top of the vehicle. Display means 
displays the image pfcked up by the camera. A limit of 
a vehicle height is detected from the image pksked up 30 
by the camera. Therefore, the driver can readily check 
whether or not the vehicle may pass under an elevated 
bridge, for example. 

[01 36] According to the invention , the re is provided a 
vehk^le parking assist device comprising: 35 

a camera for picking up scenes in the frontward and 
backward areas of a vehicle; 
display means for dispteying the image picked up 
by the camera; 40 
running condition detecting means for detecting 
running condition of the vehicle; and 
drive assist means for carrying out drive assist in 
accordance with running conditions detected by the 
running conditran detecting means in such a man- ^ 
ner thai in a normal running, the display means dis- 
plays an image of the frontward area of the vehicle, 
and in a backward running, the display means dis- 
plays more brightly an mage of the backwanJ area 
than an iirage of the forward area. so 

[0137] I n the inventk>n. the display means displays an 
image of the frontward area of the vehk;le in a nonnal 
running. In a backward running, the display means dis- 
plays more brightly an image of the backward area than ss 
an image of the fonward area. Therefore, the driver can 
watch the backward area in detail when backing the ve- 
hicle. In this respect, an effective drive assist is secured. 



[013B] According to the present invention, there is 
provided a vehicle parking assist device comprising: 

a camera for picking up scenes in the frontward emd 
backward areas of a vehicle; 
display means for displaying the image picked up 
by the canr^ra; 

running condition detecting means for detecting 
running condrtkxi of the vehicle; and 
drive assist means; and 

drive assist means for carrying out drive assist in 
accordance with running conditions detected by the 
running state detecting means by use of such a dis- 
play that in a normal running, the disptey means dis- 
plays an image of the frontward area of the vehicle, 
and in a backward running, the display means dis- 
plays more brightly an image of the t»ackward area 
than an image of the forward area, in place of a dis- 
play frame for back mirrors. 

[01 39] In the hvention, an image of the backward ar- 
ea is displayed in an intensifying manner, in place of a 
display frame for back mirrors. Accordingly, the image 
of the backward area is displayed in a display mode fa- 
miliar to the driver. The drive assist is carried out such 
that the driver can easily understand that the displayed 
image is the image of the backward area. 
[01 40] In the vehicle drive assist device, the drive as- 
sist means modifies a backward area image displayed 
in the display frame for the back mirrors into an image 
having a fieW angle equal to that of the back mirror, and 
causes the display means to display the in^ge modified 
in fiek:! angle. 

[0141] Where the camera has a wkie field angle, the 
innage picked up by the camera is distorted, and as a 
result, it is difficult to grasp the sense of distance. To 
cope with this, the inr\age is nDodified, by the cutting and 
enlarging or reducing of the image, into an image having 
a field angle equal to that of the back mirror, whereby 
the displayed Hnage matches the sight leeling of the 
driver. 

[0142] According to the present invention, there is 
provkJed a vehfcle drive assist devrce comprising: 

a camera, mounted on a vehicle, for pteWng up a 
scene of an area existing in the advar>coig directkxi 
of the vehicle; 

a steering angle sensor for detecting a steering an- 
gle of the steering wheel of the vehicle; 
traveling path predating means for calculating a 
predictive traveling path curve depending on a 
steering angle detected by the steering angle sen- 
sor, 

drive assist means for assisting the driver on his driv- 
ang operation by adding a 3-dimensional informa- 
tion image containing a height of a vehicle along the 
predctive traveling path cun^e derived from the 
traveling path predicting means; 
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display nneans tor displaying an image output tronn 
thOi camera and an image output the drive assist 
means; and 

an obstacle sensor for delecting an obstructive ob- 
ject existing in the vehicle advancing direction; 5 

wherein the drive assist nrteans changes a display 
of the 3-dimensional information image at a position on 
the predictive traveling path curve, which is close to a 
position where an obstructive object is detected by the io 
obstacle sensor, to a display which is different from dis- 
plays of the ^-dimensional image at crther positions. 
[0143] In the vehicle drive assist device thus con- 
structed, a scene of an area existing in the advancing 
direction of the vehicle is picked up by a camera mount- is 
ed on a vehicle. A steering angle of the steering wheel 
of the vehicle is detected by a steering angle sensor, 
and traveling path predicting means calculates a predic- 
tive traveling path cun^e depending on a steering angle 
detected by the steering angle sensor. Drive assist 20 
means assists the driver In his driving operation by add- 
ing a 3-dimen8ional information image containing a 
height of a vehicle along the predictive traveling path 
curve. An image output from the camera and an image 
output the drive assist means are displayed by the dis- 25 
play nr^ans. An obstructive object existing In the vehicle 
advancing direction is detected by an obstacle sensor. 
At a position close to a position where an obstructive 
object is detected, the drive assist means changes a dis- 
play of the 3-dimensional information image to a display 3q 
which is different from displays of the 3-dinrtensional im- 
age at other positions. Therefore, the driver readily 
checks a possibility that the vehicle will touch an ob- 
structive object at a position close to the object. 
[0144] In the invention, the drive assist means dis- 3S 
plays the 3-dimef^sior^al information imago in the fomn 
of planes each having a predetermined shape which are 
arrayed at fixed distances along the predictive traveling 
path curve. 

[0145] In the vehicle drive assist device, the drive as- 4<? 
sisi means displays the 3<iimensior>al information im- 
age in the form of a configuration representing a heic^t 
ot the vehicle, e.g.. rectangular planes or vehicle pro- 
jective planes, which are an-ayed at fixed distances 
along the predictive traveling path cuwe. Therefore, the <s 
vehicle height is displayed in an ease-to-understand 
fashion. Further, a three-dimensional check of a possi- 
bilily that his vehicle will touch an obstructive object is 
realty effected since at a position near the obstructive 
object, the display is changed from that at other posi- so 
tions. 

[01 46] In the invention, the drive assist moves a plane 
of a predetermined shape, which represents a height of 
the vehicle, along the predictive traveling path cun^e. 
[0147] In the vehicle drive assist device, the drive as- ss 
sist nrwves a plane of a predetenminedshape. which rep- 
resents a height ot the vehicle, such as rectangular 
planes or vehicle projective planes, along the predictive 



traveling path curve. Therefore, the driver can readily 
check a possibility that his vehicle will touch an obstruc- 
tive c^ject on the predictive traveling path curve, while 
recognizing the vehicle height. 

[0148] In the invention, the drive assist stops the 
plane of a predetermined shape, which represents a 
height of the vehicle, at a positfon which is close to a 
positton where the obstructive object is detected. 
[0149] In the vehicle drive assist device just men- 
tk>ned. the drive assist moves the plane of a predeter- 
mined shape, which represents a height of the vehicle, 
along the predictive traveling path curve, and stops the 
plane at a position which is close to a position where the 
obstructive object is detected. Therefore, the driver can 
readily check a position close to the obstructive object 
and a possibility that the vehicle will touch the obstruc- 
tive object. 

[0150] In the invention, the drive assist changes a 
color of the 3-dimensk>nal information image at a posi- 
tion which is close to a position where the obstructive 
object is detected. 

[0161] In the vehicle drive assist device, a color of the 
3-dimensional kiformatkxi innage is changed at a posi- 
tkxi which is close to a position where the obstructive 
object is detected. Therefore, the driver can readily rec- 
ognize from a color change that a display positkwi of the 
3-dimensional image approaches to the obstructive ob- 
ject. Therefore, the drive assist visually presents a pos- 
stoility that the vehicle will touch an obstructive object, 
aind a touching positkxi if it touches the object, in an 
ease-to-understand manner. 

[0152] In the inventton. the drive assist means dis- 
plays the 3-dimentional informatk>n image an the form of 
a simulation innage in which a self vehicle nnoves in the 
image picked up by the camera. 
[0153] In the vehicle drive assist device, a 3-dimen- 
sional simulation innage of the nrwving vehicle is cvertaid 
on the image picked up by the camera. Therefore, the 
driver recognizes how the vehicle moves, on the dis- 
played image, and hence he can check a possibility that 
the vehicle will touch the obstructive object, in a simu- 
lation domain. 

[0154] According to the present invention, there is 
provided a vehicle parking assist device for assisting a 
driver in his parking operatkxi comprising: 

a camera for picking up a scene of an area existing 
in an advancing direction of a vehicle; 
parking posttbn detecting nneans for detecting a tar- 
get parking position in which the vehk:le is to be 
parked, from the image picked up by the camera; 
steering angle calculating means for calculating a 
steering angle necessary for the moving of the ve- 
hble to the target parking position detected by the 
parking position detecting means; 
steering angle detecting means tor detecting a 
steering angle of the vehKle; and 
parking assist means for presenting a steering op- 
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eratjon guide to the drrver on the basis of the result 
of cfHTiparing a steering angle detected by the steer- 
ing angle detecting means with a steering angle cal- 
culated by the steering angle calculating means. 

[0155] In the thus arranged vehicle parking assist de- 
vice, when the vehicle is parked, a scene of an area ex- 
isting in an advancing direction of a vehicle is picked up 
by a camera, and a target parking position in which the 
vehicle is to be parked, from the image picked up by the 
camera is detected by parking position detecting 
means. A steering angle necessary for the moving of 
the vehtele to the target parking positfon detected by the 
parking position detecting means, is calculated by steer- 
ing angle calculating means. A steering angle of the ve- 
hicle is detected by steering angle detecting means. A 
steering angle delected by the steering angle detecting 
means is compared with a steering angle cateutated by 
the steering angle calculating means by parking assist 
means. A steering operation gukie is presented to the 
driver on the basis of the result of the comparison. The 
driver is guided so as to move the vehicle at the steering 
angle necessary for moving the vehk:le to the target 
parking position. Therefore, the driver easily judges if 
the present steering angle is proper Accordingly, it the 
driver steers according to the guWe, the vehicle may be 
properly parked in the target parking position. 
[0156] The vehicle partying assist device further com- 
prises: traveling path predicting nnoans for cafculathg, 
depending on a steering angle, a predictive traveling 
path curve along whfch the vehicle wili travel; and touch 
Judging means for judging as to whether or not the ve- 
hicle traveling along the predictive traveling path curve 
calculated by the travelrig path predrcting means will 
touch an obstructive object. In the vehwie parking assist 
device thus constructed, when a steering angle cafcu- 
lated by the steering angle calculating means is out of 
a range of steering angles withri whfch a steering wheel 
may be turned for steering or when the touch Judging 
means judges that the vehicle traveling atong the pre- 
dictive travelaig path cun/e. which is calculated by the 
traveling path predicting means deperxiingon the steer- 
ing angle, will touch the obstaictive object, the parking 
assist means urges the driver to reverse the advancing 
directk>n of the vehicle. 

[0157] In the vehicle parking assist device, traveling 
path predicting means calculates, depending on a steer- 
ing angle, a predictive traveling path curve along which 
the vehicle will travel, and touch judging means judges 
as to whether or not the vehicle traveling atong the pre- 
dictive traveling path cun^e calculated by the traveling 
path predating means will touch an obstructive object. 
When the touch judging means judges that the vehicle 
traveling along the predictive traveling path curve, or 
when a steering angle calculated by the steering angle 
calculating means is out of a range of steering angles 
within which a steering wheel may be turned for steer- 
ing, the parking assist means urges the driver to reverse 



the advancing directk>n of the vehicle. Thus, the vehicle 
pari<rig assist device supplies to the driver infomnation 
of the parking being impossible and a timing necessary 
for the reverse turn of the steering wheel. Accordingly, 
5 a guide is made so that the driver can property park the 
vehrcle into the parking space. 
[0158] According to the present inventrcwi, there is 
provkJed a vehicle parking assist 6&\f\ce for assisting a 
driver in his parking operation comprising: 

10 

a camera for picking up an image of an area existing 
in an advancing direction of a vehicle; 
parking space recognizing means for detecting a 
parking space in which the vehicle is to be parked, 

'5 from the image pk^ked up by the camera; and 

parking assist means for judging as to if a parking 
stopper for blocking the advancing of the vehble ex- 
ists in the parking space recognized by the parking 
space recognizing means and for informing the driv- 

^ er of the result of the judgement. 

[01 59] The camera picks up a scene of an area exist- 
ing in an advancing direction of a vehk^le, arxJ the park- 
ing space recognizing means detects a parking space 

25 in whfch the vehicle is to be parked, from the image 
pKked up by the cannera. The parking assist means 
judges as to if a parking stopper for blocking the advarx?- 
ing of the vehicle exists in the parking space recognized 
by the parking space recognizing means and informs 

30 the driver of the result of the judgement. Therefore, the 
driver can know the presence or absence of the parking 
stopper When he stops the vehicle at a parking position, 
he can steer and brake while referring to the stopper 
[0160] The vehicle parking assist devk:e further com- 

35 prises voice guKle means for carrying out a guide by the 
parking assist by voice. 

[0161] In the vehtele parking assist device, the park- 
ing assist guide is presented to the drrver by voice by 
the voice guide means. Therefore, the driver may take 
^ a drive guide necessary for the parking by the sense of 
hearing, not the sense of eight. 

[0162] The vok^e gukie means also gives the drrver 
warning to urge the driver to watch environmental con- 
ditbns around the vehicle. 

[0163] In the vehicle parking assist devfce, the vofee 
gukJe means urges the driver to watch the environment 
around the vehicle in the form of voice warning to the 
driver Therefore, sufficient driver's attention may be 
turned to the envirorwnent around the vehicle, thereby 
so ensuring a sate driving for partdng. 

[01 64] The vehicle parking assist device further com- 
prises display guide means for visually presenting the 
gurcfe by the parking assist together with the image by 
the camera. 

55 [0165] In the vehicle parking assist devrce. the visual 
presentatton of the gukie by the parking assist is per- 
formed together with the image by the camera. There- 
fore, the driver moves the vehicle for parking without 
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anxiety while watching the image of the dead space 
^ when vi>wed trom the driver. 

' [0166] According to the invention, there is provided a 
vehicle parking assist device for assisting a driver when 
he backs a vehicle into a parking space, by use of image 
information, the vehicle p^arking assist device compris- 
es: 

a camera lor picking up a scene of a backward area 
of the vehicle; 

display means for displaying the image of the back- 
ward area picked up by the camera; and 
parking assist means for assisting the driver in his 
parking by use of a display on the screen of the dis- 
play means In which the gukie lines protonged from 
the lines defining the width of the vehkjie arKi dis- 
tance lines are overlaid on the backward area im- 
age. 

[0167] When the camera photographs a backward ar- 
ea of the vehicle, an image of the backward area is dis- 
played on the screen of the display means. The parking 
assist means displays the guide lines protonged from 
the lines definrig the width of the vehicle and distar^ 
lines in a state that those lines are overlaid on the back- 
ward area image. Since the guide lines are prokxiged 
from of the lines defining the wkAh of the self vehicle, 
the driver can approximately grasp a distance of the 
backing self vehicle to the object with reference to the 
distance lines after the vehicle is directed to be parallel 
to the boundary lines of the parking space In which the 
self vehicle is to be parked and other parking spaces 
adjacent to the former, and easily grasps a distance that 
the vehicle runs till the parking is ended and the vehicle 
is stopped. 

[0166] According to the invention, there is provided a 
vehicle parking assist devtee for assisting a driver when 
he backs a vehicle into a parking space, by use of in^age 
information, the vehicle parking assist device comprfe- 
es: 

a camera for picking up a scene of a backward area 
of the vehicle; 

display means for displaying the image of the back- 
ward area picked up by the camera; 
a steering angle sensor for detecting a steering an- 
gle of the self vehicle; 

traveling path predicting means for predicting a 
traveling path of the self vehicle on the basis of a 
steerrtg angle detected by the steering angle sen- 
sor and for calculating a predfctive traveling path 
curve representing the result of the predk^tton; 
parking position judging means for judging a park- 
ing position at which the self vehkile is to be parked; 
arKl 

parlcing assist means for effecting a parking assist 
in such a way that a length of a predictive traveling 
path curve cafcu feted by the traveling path predict- 



ing means is adjusted in accordance vyith a distance 
ranging to a parking position judged by the parking 
positkxi judging means, and the predictive traveling 
path cun^e length adjusted is overlaid on the back- 
5 ward area image on the screen of the display 
means. 

[0169] In this vehk^le parking assist device, a length 
of a predictive traveling path curve that is predicted on 
the basis of a steering angle of the self vehicle is adjust- 
ed in accordance with a distance ranging to a parking 
position at which the self vehwle is to be parked. There- 
fore, the end of the predictive traveling path curve is co- 
incident with the partying positton, and hence the parking 
'5 assist is performed by using a display which is easy for 
the driver to watch. 

[0170] According to the present invention, there is 
provided a vehicle parking assist devbe for assisting a 
driver when he backs a vehtele into a parking space, by 
^ use of image informatton, the vehicle parking assist de- 
vice corrprises: 

a camera for pkiking up a scene of a backward area 
of the vehicle; 

^5 display means for displaying the image of the back- 
ward area picked up by the camera; 
a steering angle sensor for detecting a steering an- 
gle of the self vehicle; 

traveling path predicting means for predicting a 
50 travelhg path of the roof portion c4 the self vehicle 
on the basis of a steering angle detected by the 
steering angle sensor and for calculating a predic- 
tive traveling path curve representing the result of 
the predict kxi; and 
^ parking assist means for effecting a paridng asset 
in such a way tfiat a predictive traveling path curve 
of the roof portion of the vehicle, which is calculated 
by the traveling path predk:ting mearw, is overlaid 
on the backward area innage on the screen of the 
display means. 

[0171] In this vehicle parking assist devk;s, a roof pre- 
dictive traveling path curve of the nx>f portion of the self 
vehfcle is displayed while overiaid on the backward area 

45 Image for the parkhg assist Therefore, the vehicle can 
be backed while being unconscious of the skJe of the 
vehk:le adjacent to the parking space which forms the 
dead space when the driver backs the vehicle atong the 
predfctive traveling path curve so as not to touch the roof 

^ ofthevehicte being parked In the partying space to whfch 
the parking space is adjacent. 

[0172] According to the present invention, there is 
provkied a vehicle parking assist device for assisting a 
driver when he backs a vehicle into a paridng space, by 
^ use of image informatkxi, the vehicle parking assist de- 
vice comprises: 

a camera for picking up a scene of a backward area 
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Of the vehicle; display means for displaying the im- 
age of the backward area picked up by the camera; 
a steering angie sensor for detecting a steering an- 
gle of the self vehicle; 

traveling path predicting means for predicting a 5 
traveling path of the self vehicle on the basis of a 
steering angle detected by the steering angle sen- 
sor and for cafouteting a predfctive traveling path 
curve representing the result of the prediction; 
vehicle projection means arranged such that the ve- io 
hide prpjectkjn means judges if crther vehicles park 
in parking spaces located adjacent to a parking 
space under photographing by the camera, and 
when other vehicles park therein, the vehicle pro- 
jection means cabulates a projective line of the ve- is 
hide on the ground; and 

parking assist means for effecting a parking assist 
in such a way that a predkjtive traveling path curve 
calculated by the traveling path predk:ting means 
ar»d a projective line of the vehfcle to the ground cal- ^ 
c dated by the vehicle projection means are overlaiid 
on the backward area image on the screen of the 
display means. 

[0173] In this vehicle parking assist device. In case 
where a scene of a parking space into whfeh the self 
vehicle is backed is picked up by the camera, when an- 
other vehicle is parked in a parking space adjacent 
thereto, the projective line of the vehicle to the ground 
is calculated, and the calculated projective line and a 3Q 
predictive traveling path curve are overlaid on the back- 
ward area on the screen of the display oceans, and in 
this state, the parking assist is performed. Therefore, 
reliable judgement is made as to rf there is an area whfch 
hides behind another vehicle, being dead space of the 36 
irrage. affects the predidive traveling path curve of the 
other vehicle. Therefore, when the self vehicle is guided 
to the parking area, reliable judgement is made as to it 
the vehk:le may nrtove into the parking area without 
touching the other vehicle even in a shaded area in the 40 
image of the other vehicle. 

[0174] According to the present irwention. there is 
provided a vehicle parking assist devk^e for assisting a 
driver when he t>acks a vehicle into a parking space, by 
use of Image information, the vehicle parking assist de- 45 
vice comprises: 

a camera lor picking up a scene of a backward area 
of the vehicle; 

display means for displaying the image of the back- so 
ward area picked up by the camera; 
plane model generating means for generating from 
the backward area image picked up by the camera 
a plane model containing a parking space in which 
a se If veh icie is to be parked and the parki ng spaces 55 
located adjacent to the parking space, together with 
the self vehicle and other vehicles being parked; 
and 



parking assist means for effecting a parking assist 
by displaying a plane model generated by the plane 
model generating means on the screen of the dis- 
play means. 

[0175] In this vehicle parking assist device, the park- 
ing space in which the self vehicle is to be parked, and 
the parking spaces adjacent to the former are modeled 
in a pl£uie. and those are displayed in the form of a plane 
model. Further, the parking spaces of the self vehrcle 
and other vehk;les. which are parked in those parking 
areas, are also displayed in the plane rrKxiel. Therefore, 
the parking spaces and the vehicles may be displayed 
in a bird's eye view, and this provkfes an easy4o-under- 
stand peirking assist. Since the parking spaces arKi the 
vehkiles are displayed in a pteine. the driver can easily 
grasp positbr^ ol the self vehk;le relative to the parking 
areas and the vehicles parked adjacent to the former, 
and the orientatkx} of the vehicle and its advancing di- 
rectton. 

[0176] In the vehicle parking assist devrce. the park- 
ing assist means displays an image on the screen erf the 
display means so that the backward directfon of the self 
vehk^le is oriented downvmrd. 

[01 77] Thus, the backward directkxi of the self vehicle 
is thus oriented downward. This display is well fit to the 
feeDng of the driver Therefore, when the driver watches 
the screen of the display means, he is easy to under- 
stand the contents displayed on the screen. 
[0178] In this vehk;le parkir>g assist devk;e, the park- 
ing assist means is capable of selectively displaying the 
backward area inriage output from the camera and the 
parkrig assist image or the plane mo6e\ to be displayed 
overfeikJ on the l>ackward area imago on the screen of 
the display means 

[0179] In this vehicle parking assist devfce, the park- 
ing gufcJe may be swrtched between the parking gukie 
modeled in place or the parking guide based the back- 
ward area image. Therefore, the driver selects, as de- 
sired, the paridng guide modeled in place or the actual 
parking gukje based the backward area image, and it 
effeds the parking assist which is easy for the driver to 
understand. 

[0160] According to the present invention, there is 
provided a vehicle parking assist devfce for assisting a 
driver using image information when the driver tracks a 
vehk^le into a parking space, the vehicle parking assist 
devk?e comprises: 

a camera for picking up a scene of a backward area 
of the vehicle; 

display means for displaying the image of the back- 
ward area picked up by the camera; 
a timer for counting a predetermined time; 
direction ctetecting means for detecting a change <rf 
the advancing directk>n of the vehtele; and 
parking assist means arranged such that when the 
direction deteding means detects a change of the 
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advancing direction of the vehicle to the backward 
directioa the parking assist means displays the 
backward area image picked up by the camera on 
the screen of the display means to assist the driver 
in his parking operatioa and when the direction de- 
tecting means detects a change of the advancing 
direction of the vehtele from the backward direction 
to the fonward directk)n, the parking assist causes 
the timer to start the counting of lime, and continues 
the parking assist based on the backward area dis- 
play on the screen of the display means till a time 
set in the timer elapses. 

[0181] In this vehtele parking assist devtee. when the 
vehicle backs, the parking assist based on the backward 
area image is carried out. Even if the advancing direc- 
tion of the vehk^le is changed from the backward direc- 
tion to the fonvard directkxi, the parking assisting oper- 
ation continues with the display the backward area 
inrege till the time set in the timer tenminatee. Therefore, 
the backward area is easily checked when the vehicle 
advances and when the steering wheel is reversely 
tumed. Further, when the steering wheel is reversely 
turned, the vehicle parking assist device displays ayard 
stk:k in estinnating, by the eye. what distance the vehicle 
must be advanced in an easy4o-undefstand nnanner, for 
the parking assist. 

[0182] According to the invent k>n. there is provided a 
vehicle parking assist devk:e in whfc^ when a driver 
backs a vehicle into a parking space between adjacent 
vehfcles of those being parked in a row. the vehicle park- 
ing assist device assists the driver in his parking oper- 
atk>n by image-infonmation basis guide, the vehicle 
parking assist device comprising: 

a camera for picking up a scene of a backward area 
of the vehicle; 

a steering angle sensor for detect rtg a steering an- 
gle to steer the vehicle; 

traveling path predicting means for predating a 
traveling path of the vehicle an the basis of a steer- 
ing angle detected by the steering angle sensor and 
for calculating a predictive traveling path curve; 
timing Judging means tor detecting a target parking 
positkDn on the basis of the inr^ige pteked up by the 
camera and for judging a timing to reversely turn a 
steerrig wheel by an amount of turn of the steering 
wheel necessary to move the vehicle to the target 
parking position; 

parkng assist means for generating a composite 
image of an innage derived from the camera and a 
predictive traveling path curve predicted t>y the 
traveling path predicting means, and for adding 
guWe infonration for a steering operatk>n defined 
by a reverse-turn timing judged by the timing judg- 
ing means to the composite innage, whereby the 
parking assist means assists the driver in the serial 
parking operation; and 



display means for display an image derived from the 
parking assist means. 

[0183] The scene of a backward area of the vehfcle is 

5 pk^ked by a camera, and the steering angle to steer the 
vehble is detected by a steering angle sensor The 
traveling path predicting means predtets a traveling path 
of the vehicle on the basis of a steering angle detected 
by the steering angle sensor and calculates a predk;tive 

10 traveling path curve. The timing judgir>g means detects 
a target parking position on the basis of the image 
picked up by the camera and judges a timing to reverse- 
ly turn a steering wheel by an amount of tum of the steer- 
ing wheel necessary to move the vehicle to the target 
parking posit k>n. The parking assist means generates a 
composite image of an image derived from the camera 
and a predictive traveling path curve predk:ted by the 
traveling path predating means, and adds gurcio infor- 
matton fora steering operatfon defined by a reverse-turn 

^ timing judged by the timhg judging means to the com- 
posite image, whereby the parking assist rrieans assists 
the driver in the serial parking operatk>n. A predk;tive 
traveling path curve is displayed together with a back- 
ward area image of the vehrcle. Further, guide infonna- 

2S tfon showing such a timing of reversely turning the steer- 
ing wheel as to back the vehtele into a target paridng 
position is also displayed. Accordingly, the driver easily 
drives the v^k:le for the series parking while watching 
the screen of the infomnatkjn display device. 

30 [01 64] In the invention, the parking assist means adds 
an oblique tine as the gukJe information for the steering 
operation to a positton on a predicted traveling path 
curve at which the steering wheel is to be reversely 
tumed. 

5^ [0186] Thus, the parking assist means adds an ob- 
lk)ue line as the gukie information for the steering oper- 
ation to a positk>n on a predicted travelrig path curve at 
whteh the steering wheel is to be reversely tumed. Ac- 
cordingly, the parking is completed by reversely turning 

40 the steering wheel when the oblique line lies on a target, 
e.g.. a road edge. Therefore, the driver readily rmkes a 
series parking without touching of the vehicle with an- 
other vehicle being parked adjacent to the vehicle driven 
by the driver. 

45 [01 86] The parking assist means assists the driver in 
the series parking on the basis a backward rTK>vement 
of the vehk^le and a combination of lighting corKiitions 
of a hazard lamp and^or winker lamp. 
[0187] In the invention, the paridng assist means as- 

50 sists the driver in the series parking on the basis a back- 
ward movement of the vehfele and a combination of 
lighting conditbns of a hazard lamp and/or winker tamp. 
Therefore, there is no need of switching operation for 
starting the series parking assist. The series parking as- 

5S sist is aulonnatically carried out if the hazard lamp and/ 
or winker lamp is lit to give the drivers of other vehicles 
a sign showing that the series parking wll start. In this 
respect, there is eliminated troublesome switching op- 
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erations. 

, [0188] . In the invention, the parking assist means judg- 
es which side of the road is used for the series parking 
on the basis of a combination of lighting conditions of 
the hazard lamp and/or winker lamp, and adds the gukJe 5 
information to the composite image according to the 
judgement result. 

[018S!1 Thus» the parking assist means judges whfch 
side of the road is used for the series parking on the 
basis o* a combination of lighting conditions of the haz- to 
ard lamp and/or winker lamp, and adds the guide infor- 
mation to the conrtposite image according to the judge- 
ment result. When one of the winker lamps is lit. It is 
judged that the vehicle will be series parked along the 
same side of the road as the side of the car to whfch the 
tit winker lanrp is attached, and the series parking guide 
information prepared for such a series parking is at- 
tached to the composite image. When the hazard lamp 
is m, it is Judge that the vehicle will be series parked on 
the left side of the road as usualty, and the vehicle park- ^ 
ing assist device assists the driver to drive the vehicle 
for parking. Since the parking assist means assists the 
driver n rmking the series parking, the parking assist of 
the device is free from the complicated switching oper- 
ations. 25 
[01 SO] The parking assist means generates an ideal 
traveling path ranging from the present position to a tar- 
get parking position detected by the ttmaig judging 
means, for the steering guide infonmation. 
[01 en] Thus, an ideal traveling path ranging from the 30 
present posttran to a target parking positk>n detected by 
the timing judging means, is generated for the steering 
guide infonmation. Therefore, the driver easily backs the 
vehk^le into a target parking posftk>n by steering the ve- 
hicle so as to approximate in shape the predictive 55 
traveling path cun^e to the ideal traveling path. 
[01 92] The vehicle parking assist device further com- 
prises lane monitoring nrteans for recognizing border 
lines of a traffic lane and rrK)nitoring an out-of-iane of 
the vehicle on the basis of the border line recognitkxi. 40 
[0193] In the vehicle parking assist device, lane mon- 
itoring means recognizes border lines of a traffic lane 
and monitors an out-of-lane of the vehicle on the basis 
of the border line recognition. Therefore, one canrwra 
ruay be used for both the camera whteh monitors a back- 4S 
ward area of the vehk^le for parking assist and the cam- 
era for nrK>nitoring an out-of-lane of the vehicle. There- 
fore, the vehicle parking assist device needs less cost 
when comparing with the vehicle parking assist devfce 
using two cameras for the above purposes. bo 
[019^0 In the vehicle pari<ing assist devtee, the park- 
ing assist means judges whether or not the vehicle may 
back to a target parking positkxi detected by the timing 
judging means within a range of steering angles within 
which the steering wheel nnay be turned, and whether ss 
or not the vehfcle moves out of the traffic lane nrionitored 
by the lane monitoring means, and the parking assist 
means assists the driver in the series parking on the ba- 



sis of the judgement results. 

[01 95] In the invention, the vehicle may b^k to a tar- 
get parking position within a range of steering angles 
within which the steering wheel may be turned. Further, 
judgement is made as to whether or not the vehicle 
moves out of the trafTic lane monitored by the lane mon- 
itoring means. The parkhg assist means assists the 
driver in the series parking on the basis of the judgement 
results. Therefore, the driver may back the vehicle into 
a parking ^ace between the ad^cent vehrdes of those 
t>eing parked in row. without getting the vehicle out of 
the lane. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0198] Fig. 1 is a perspective view schematically 
showing a vehicle parking assist device which is a first 
emtxxiinnent of the inventk>n. 

[0197] Fig. 2 is a perspective view schematically 
showing a state that a vehtele 1 backs for parking in the 
Fig. 1 embodiment. 

[0198] Fig. 3 is a block diagram showing a parking as- 
sist ECU 6 in the Fig, 1 embodiment. 
[0199] Figs. 4A to AO are diagrams showing parking 
assistdisplays dispteiyed on the screen of an infonmation 
display devk:e 4. 

[0200] Fig. 5 is a diagram showing a navigatbn dis- 
play 41 and a audio display 42, whk:h are presented on 
the screen of the inforrnatK>n display devrce 4. 
[0201] Fig. 6 is a diagram showing a display by the 
informatton display devfce 4, which infomns that a shift 
lever is shifted to the reverse gear position . 
[0202] Fig. 7 is a diagram showing a display by the 
information display device 4, which informs that an ob- 
structive object is detected, the parking operatk>n is 
completed. arKJ urges the driver to make a check by the 
eye. 

[0203] Fig. 8 is a block diagram showrig a scheme of 
a vehtele parking assist device which is a second em- 
bodiment of the invention. 

[0204] Fig. 9 is a diagram showing a parking ass^t 
display on the screen of the infomiation display devk^e 
4 in the Fig. 8 embodiment 

[0205] Fig. 10 is a block diagram showing a schenne 
of a vehicle parking assist devtee which is a second em- 
bodiment 

[0206] Fig. 11 is a plan view showing a plurality of 
camera units 10 disposed arourwJ a body of a vehble 1 , 
whkti is a fourth embodiment of the inventk>n. 
[0207] Figs. 12(1)to 12(12) are diagrams exemplarily 
each showing segmented display areas on the screen 
of the infonratkjn display device 4 in the Fig. 11 embod- 
iment, ornages output from the camera units 10 being 
simultaneously displayed in those segmental areas. 
[0208] Fig. 1 3 is a diagram exemplarily showing seg- 
mental display areas on the display screen anda display 
containing a vehicle IHustratbn 70 in the Fig. 11 emt>od- 
iment. 
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[0209] Fig. 1 4 is a diagram showing a state that a po- 
'sition of'tha vehicle illustration 70 Is shifted In accord- 
ance with a camera image in the Fig. 11 embodiment. 
[0210] Fig. 15 is a diagram showing a vehicle illustra- 
tion 70 and the direction artd area of a camera image in 
the Fig. 11 embodiment 

[0211] Fig. 16 Is a diagram showing a camera image 
71 being divided into a navigation display 41 and an au- 
dio display 42 in the Fig. 11 embodiment. 
[0212] Fig, 18 is a diagram showing a state in which 
a plurality of image displays are changed one to another 
by a w^3e method in the Fig. 11 embodiment. 
[0213] Rg. 11 is a diagram showing a segmented 
screen containing images in which segmental display 
areas and display positions are varied in accordance 
with a steering angle of a steering wheel. 
[0214] Fig. 19 is a block diagram showing a scheme 
of a vehicle parking assist device which is a fifth embod- 
iment of the lnventk>n. 

[0216] Figs. 20A. 20Band 20C are diagrams showing 
how obstacle displays are changed to another on the 
screen of an informatk>n display device informatbn dis- 
play device 74. 

[0216] Figs. 21 A and 21 B are diagranns showing a 
drive assist which is carried out by seamlessly compos- 
ing the images picked up by a plurality of camera units 
10 bito a single image, the drive assist forming a sixth 
embodiment of the inventkxi. 

[0217] Rgs. 22A and 22B are diagrams showing how 
to display images, which are produced by picking up the 
entire ctrcunnferential area around a vehicle 1 . on the 
display screen in the Rgs. 21 A arid 21 B embodiment. 
[0218] Rg. 23 is a btock diagram showing a scheme 
of a vehk^le parking assist devk:e whk:h is a seventh em- 
bodiment of the invention. 

[0219] Figs. 24A and 24B are diagrams showing dis- 
plays on the screen of a Information display device 4. 
74 in which a brightness of the display in the fonvard 
nrxwement of the vehicle is different from that of the dis- 
play in the backward movement, in each of the embod- 
iments. 

[0220] Fig. 25 is a diagram showing a backward area 
disptey presented within adisp^y frame 87. which clear- 
ly shows the driver that the image being displayed is that 
of the backward area. 

[0221] Fig. 26 is a block d'agram ^ovyring a basic ar- 
rangement to carry out a parking assist in eighth to 11th 
emtx>diments of the present inventkxi. 
[0222] Fig. 27 is a diagram showing a state that a ve- 
hicle 101 backs to parking zone 102 and parks there. 
[0223] Fig. 28 is a blockdlagram showing an electrical 
arrangement of a parking assist ECU 106 in Fig. 26. 
[0224] Fig. 29 is a diagram showing, in a simplified 
form, an image to be displayed by an informalkxi display 
device 104 in the parking assist of the eighth embodi- 
ment of the invention. 

[0225] Fig. 30 is a fk:>w chart showing a control proce- 
dure in the Fig. 29 embodiment. 



[0226] Fig. 31 is a diagram showing, in a somplified 
form, an image to be displayed by an information display 
devk:e 104 in the parking assist of the ninth embodiment 
of the rivention. 
5 [0227] Fig, 32 is a flow chart showing a control proce- 
dure in the Fig. 31 embodiment. 
[0228] Fig. 33 Is a diagram showing, in a simplified 
fonri, an Image to be displayed by an inloonation display 
device 104 in the parking assist of the tenth embodiment 
of the rivention. 

[0229] Fig. 34 is a flow chart showing a control proce- 
dure in the Fig. 33 embodiment. 
[0230] Fig. 35 is a diagram showing, in a sfrrtpllfled 
form, an image to be dispteyed by an informatkxi display 
devk;e 104 in the parking assist of the eleventh embod- 
iment of the invention. 

[0231] Fig. 36 is a flow chart showing a control proce- 
dure in the Fig. 35 errtbodiment. 
[0232] Fig. 37 is a bkx:k diagram schematically show- 

^ ing an arrangement of a vehicle drive assist device ac- 
cording to a 12th embodiment erf the present invention. 
[0233] Fig. 38 is a diag ram showing a state that by the 
utilization of the vehicle drive assist devk:e of Fig. 37, 
the driver backs the vehicle 201 to a parking space 

2S marked off with white Iries 203 and paries it there. 
[0234] Fig. 39 is an electrical arrangement of the park- 
ing assist ECU 206 shown in Fig. 37. 
[0235] Fig. 40 is a flow chart showing a parkhg assist 
procedure, which is carried out by the parking assist 

30 ECU 206 in the 1 2th embodiment. 

[0236] Rg. 41 is a bkx:k diagram showing a basic ar- 
rangement tor a drive assist in each embodiment of the 
present invention. 

[0237] Fig. 42 is a diagram showing how a vehicle 301 
^ of Fig. 41 backs to a parkkig zone 302 and parks therein. 
[0238] Fig. 43 is a block diagram showing an electrical 
arrangement of a parking assist ECU 306 in Fig. 41 . 
[0239] Fig. 44 is a diagram roughly showing an image 
displayed on the screen of an information display devk^ 
<o 304 in a parking £issist of the first embodsnent of the 
invention. 

[0240] Fig. 45 is a diagram roughly showing an image 
displayed on the screen of an information display device 
304 in a parking assist of the second embodiment of the 
^ Invention. 

[0241] Fig. 46 is a diagram roughly showing an image 
displayed on the screen of an information display device 
304 in a parking assist of the third embodiment of the 
invention. 

so [0242] Fig. 47 is a diagram rou^ly showing an inrtage 
displayed on the screen of an information display device 
304 in a parking assist of the fourth embodiment of the 
invention. 

[0243] Fig. 48 is a diagram roughly showing an image 
55 displayed on the screen of an inf onmation display device 
^>4 in a parking assist of the fifth emtxxitment of the 
invention. 

[0244] Fig. 49 » a block diagram showing an electrical 
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arrangement or a parking assist ECU 366 used in a sbcth 
• embodiment of the invention. 
[0245] Fig. 50 is a flow chart showing a control proce- 
dural in the Fig. 50 embodiment. 
[024G] Fig. 51 shows an extenr^l appearance of a ve- 
hicle which will undergo a series parking assist in 19th 
and 20th embodiments of the present Invent kxi. 
[0247] Rg. 52 is a plan view showing a basic arrange- 
ment for a drive assist when a series parking of the ve- 
hicle of Fig. 51 starts. 

[0248] Rg. 53 is a block diagram showing an electrical 
arrangement of a parking assist ECU 406 shown in Fig. 
51. 

[0249] Fig. 54 schematically shows an image display 
for the series parking assist, which ts carried out as the 
1 9th embodiment of the present irrventk>n. 
[0250] Fig. 55 shows a control procedure in the em- 
bodiment of Fig. 54. 

[0261] Fig. 56 is a diagram showing a series parking 
assist image in 20th embodiment of the present inven- 
tion. 

[0252] Fig. 57 is a flow chart showing a control proce- 
dure by the DSP in the Fig. 56 embodiment. 

DETAILED DESCRIPTION OF THE PRESENT 
INVErJTION 

[0253] Figs. 1 arxi 2 are diagrams showing a scheme 
of a vehicle parking assist device which is a first embod- 
iment of the present invention. Like reference numerals 
are used, for simplicity, for designating like or equivalent 
portions through the drawings which will be referred to 
in the description of the preferred embodiments of the 
invention. 

The vehicle parking assist devce of the embodirrrent as- 
sists the driver to correctly park a vehk:le into a parking 
space marked off with white lines 3 or the like, through 
the backward movement of the vehicle. A drrve assist 
displays a predictive traveling path curve 6a represent- 
ing as a predk:tfve traveling path on the screen of an 
information display device 4 as display means» or white 
lines 5b prolonged from the lines demarcating both 
sides of a vehicle 1 on the display screen, whereby a 
drive assist for the driver is performed. 
The predictive traveling path cunre 6a and the white 
lines 5b are generated by an eJectronic control unit (re- 
ferred to as a 'parking assist ECU 6') for the parking 
assist by use of detectk>n data of a steering angle and 
the like. The generated ones are dispteyed by the infor- 
mation display device 4. 

When the driver operates a shift lever 8 of a transmis- 
sion of the vehicle 1 to change the advancing direction 
of the vehicle to a backward directbn, the parking assist 
ECU 6 causes the information display device 4 to dis- 
play a predictive traveling path curve 5a and white lines 
5b on the screen thereof. At this time, a speaker 9 pro- 
duces an alarm sound or a voice sound for guide. 
[0254] An image picked by a camera unit 1 0 attached 



to the rear part of the vehicle 1 is also displayed on the 
screen of the Inf omnatton display devtese 4, In addition to 
the predictive travelhg path curve 5a and the white lr»es 
5b generated by the parking assist ECU 6. In the image 
5 pk^ked up through the field 10a of the camera unit 10, 
an areal portion which is not clearly viewed by the driver 
or is a dead space as viewed from the driver is clearly 
viewed. The image assists the driver in parking the ve- 
hk;le 1 into the parking zone 2 in an easy-to-understand 
manner, in cooperatkxi with the predictive traveling path 
curve 5a and the white lines 5b. 

[0255] A direction of the predictive traveling path 
curve 5a generated by the parking ass ist ECU 6 Is varied 
in accordance with a steering operatkxi of the steering 

IS wheel 7. A steering operation of the steering wheel 7 is 
obtahed by detecting an angular displacement of a 
steering shaft 1 1 by an angle sensor 12. In a normal ve- 
bkt\e 1 . the steering wheel 7 may be turned by several 
turns. Therefore, the angle sensor 12 for detecting a 

^ steering angle detects an angular displacement and its 
direction of the steering shaft 11 . detects a state of the 
steering shaft 11 positioned at the center positkxi. 
[0256] In the dtsp^y, the white lines 5b are overlaid 
on the Dmage pteked up by the camera unit 10. In this 

2S case, the white lines 5b are prolonged from the lines de- 
fining the body wkith of the vehicle 1 . The direction of 
the whKe lines 5b is fixed with respect to the fiekJ 10a 
of the c£mnera unit 10. The vehcle 1 is equipped with a 
con-light sensor 1 4 whkjh senses a brightness of the en- 

30 vironment and controls a lighting conditk>n of an illumi- 
nation system. A brightness and cotoring of the predte- 
tive traveling path curve 5a and the white lines 5b, which 
are dispfeyed by the Infomnation display devk^e 4, are 
varied in accordance with a brightness of the environ- 

^ ment of the vehicle 1 . Thus, those are adjusted so as to 
provkJe an easy-to-urxJerstand drive assist 
[0257] The vehicle 1 Is also equipped with car-carried 
devk^. such as a navigatbn device 15 and an audk> 
devrce 16. and necessary Infomnation is displayed by 

40 the informatk>n display devk:e 4. The vehble 1 Is further 
equipped with a back sonar 1 7 and a comer sensor IB 
as obstacle sensors. An obstructive object existing h 
the dead space by the utilization of ultrasonic waves. 
[0258] Fig. 3 shows the innards of the paricing assist 

^ ECU 6 shown in Figs. 1 and 2. The parking assist ECU 
6 contains a digital signal processor (DSP) for control- 
ling the overall system of the device. The 08P 20 carries 
out controls and signal processings through a bus 21 . 
A signal representing an inrkage picked up by the camera 

5o unit 1 0. which is of the NTSC type, is Input to an ampli- 
fier/fitter circuit 22. Then, rt Is input to an analog to digital 
converter (ADC) 23. The ADC 23 converts a signal form 
of the image signal into a digital form. The digitized sig- 
nal is stored into an amplifier/filter circuit 24. A video sig- 

^ nal output from the amplifier/filter circuit 24 is also ap- 
plied to a sync separation circuit 25 where a horizontal 
sync signal and a vertical sync signal are separated from 
the video signal. Those separated ones are input the 
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DSP 20. 

. [0259] ' The DSP 20 receives an angle detect signal 
from the angle sensor 12 for detecting an angular dis- 
placement of the steering shaft 1 1 and a center position 
detect sigial from the center position sensor 1 3. The 5 
DSP 20 carries out a parking assist process by use of 
progranns and data stored in a program menrtory 27 and 
a cteta nnemory 28. both being connected to the bus 21 . 
The storage mennory 29» whch is backed up by a bat- 
tery, is capable of retaining the contents stored therein io 
even when a power supply 35 of the parking assist ECU 
6 is not turned on. 

[0260] The DSP 20 recognizes the white lines 3 on 
the basis d an Incoming video signal, and generates a 
predictive traveling path curve 5a when an angular dis- '5 
placement operation of the steerffig shaft 11 is per- 
formed, and white lines 5b. The generated innages are 
stored into field buffers 31 and 32, either of which is se- 
lected by a switch (SW) circuit 30. The signal selected 
by the SW circuit 30 is input to a digital to analog con- 
verier (DAC) 33, and passes through a filter/amplifier 
circuit 34, and is output as a video signal to the hfomna- 
tion display device 4. Electric power is supplied to the 
whole system of the parking assist ECU 6. When a reset 
sigpnal is supplied to the parking assist ECU by the reset 25 
circuit 36 when the power supply is turned on. Further, 
a clock signal defining a basic operatkxi timing of the 
parking assist ECU and sigr^s having frequencies 
fonned by demultiplying the frequency of the clock sig- 
nal are also applied to the parking assist ECU. 30 
[0261] Each of Figs. 4A to 4C exemplarily shows im- 
age infomoation for parking assist which is displayed on 
the screen of the infonration display device 4. Fig. 4A 
shows an image corresponding to a state that the vehi- 
cle 1 1S backed into a parking position 40. The white lines 9S 
5b prokxiged from the lines defining the vehicle width 
are displayed on the backward image, together with a 
predictive traveling path curve 5a predicted on the basis 
of a steering angle. As shown in Fig. 4B, only the pre- 
dictive traveling path curve 6a is added to the backward <o 
inrrage for the parking position 40, or only the backward 
image is added thereto as shown in Fig. 4C. Further, 
only the white lines 5b may be overlaid on the backward 
image shown in Fig. 4C. 

[0262] The driver can know the present direction of 4S 
the vehicle 1 under parking assist from a display of the 
while lines 5b. Where the while lines 3 are drawn on 
both sides of the parking position 40 to form a parking 
frame, the driver can easily park the vehicle 1 in parallel 
with a space off the parking positton 40 In a manner that so 
when the white lines 3 are parallel to the white lines 6b, 
the driver returns the steering wheel 7 to the center po- 
5itk>n. 

[0263] As shown in Figs. 4A to 4C, a display of the 
predictive traveling path cun/e 5a or the white lines 5b ss 
rr^y be selected as desired by a select switch provided 
for selecting a display mode. In a specific example, the 
predictive traveling path curve 5a is displayed for a fixed 



time only when a predetermined driving operatk>n, e.g., 
an operation of the steering wheel 7. is performed. The 
white lines 5b is displayed for a fixed tone only when the 
br£Lking operation is performed. Those operatkxis eire 
autonnatically controlled. 

[0264] A brightness and color arrangement of the pre- 
dictive traveling path curve 6a and the white lines 5b are 
varied in accordance with a brightness of the environ- 
ment of the vehicle 1 , whk;h is sensed by the con-light 
sensor 14. For example, when the environment is dark, 
the display is also dark, whereby the backward image 
is in harmony with the predictive traveling path curve 5a 
and the white lines 5b. The cotors of the predictive 
traveling path cuoire 5a and the white lines 5b are also 
adjusted in accordance with a brightness and the cotor- 
ing of the environment so that the driver is easy to see 
them. Since in the daytime, the environment scene is 
bright, a distinctive color, e.g., yellow, is used. At night, 
the environnr>ent is dark. Therefore, if a distinctive color 
is used, the backward image is difficult to see. Accord- 
ingly, in this case, a dark and thin color is used. 
[0265] In the embodiment, the con-light sensor 14 is 
used for inputtang a brightness of the environment to 
vary the brightness and the cotor of the predksttve 
traveling path curve 5a arK* the white lines 5b. If re- 
quired, a sensor exclusively used tor the brightness 
sensing purpose rriay be used. The brightness may be 
detected from an image of a picture picked up by the 
camera unit 10. When the camera unit 10 is capable of 
picking up a color image, a color is also detected from 
the inrege. In this case, the colors of the predfctive 
traveling path curve 5a and the white lines 5b may be 
changed while being interconnected in operaton with 
the detected cotor. 

[0266] In a case where as shown in Figs. 4A to 4C. 
the parking assist image is changed to another by the 
operation of the switch by the driver, the final select state 
in the previous parking assist operation is stored into the 
storage menrxxy 29 and the first select state in the paric- 
ing assist operation now conducted is set on the basis 
of the final select state stored. If the select state provki- 
ing an easy-to-see display for the driver is obtained 
through the above operation, that select state nnay be 
used for the next parking assist arKf the subsequent 
ones. 

[0267] Rg. 5 shows a display by the informatk>n dis- 
play device 4, ^e display containing a navigation dis- 
play 41 from the navigatton devk^e 15 in Fig. 1 arKJ an 
audk? display 42 from the audk> device 16. The driver 
may select, as needed, the backward iimge of the paric- 
Ing position 40 for parking assist, the navigation display 
41 or audio display 42, whereby the rifomTation display 
devkie 4 is effectively used for disptey. 
[0268] Fig. 6 shows a display by the Dnfornaatk>n dis- 
play device 4, which infomns the driver that the shift lever 
8 is shifted to the reverse gear position. A telop 43 of 
"Reverse Gear" is displayed for a fixed time on the back- 
ward image representing the parking p>osrtk)n 40. The 
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driver sees the telop 43. and easily understands that the 
„ shift lever ts at the reverse gear position. With the telop 
displayed, there is no charK^ that the shift position slips 
off the driver's memory and the driver mistakenly recog- 
nizes that the vehicle is in the fon^/arding state» and 5 
abruptly starts the (onward movement of the vehicle. The 
color of the entire screen may be changed in place of 
the display of the telop or together with the display of 
the telop 43. 

[0269] Fig. 7 shows a display containing a telop 44 io 
showing an obstacle detection by the back sonar 1 7 or 
comer sensor 18. a telop 45 showing the parking end, 
and a telop 46 urging the driver to make a check by the 
eye. When the back sonar 17 or the comer sensor 18 
detects an obstructive object kx;ated near the vehicle 1 . is 
a tetop 43 of ■obstacle' or "STOP", showing that an ob- 
stacle is present for a predetermined time, and urges 
the driver to turn his attention to the obstructive object. 
The obstructiviB object detected by the back sonar 17 or 
the comer sensor 1 8 could be contained in the backward 20 
image near the parking position 40. In this case, the driv- 
er sees the telop 44 and watches the backward image. 
If so done, he win readily recognize the obstructive ob- 
ject 47 by the eye. When the obstructive object 47 is 
detected, the cokDr of the whole screen may be changed 25 
In place of the display of the tetop 44 or in combination 
of the display of the telop 44. to call the driver's attention 
to the obstructive object. 

[0270] The tetop 45 of the parking end is displayed 
when the ol>stacle sensor, such as the back sonar 1 7 or ^ 
the comer sensor 18. detects a car stopper or a wall, 
and the vehtele approaches to the detected one within 
a predetermined distance from the detected one. Dis- 
play of the tetop 45 of "parking end" or 'STOP" infomrts 
the driver of the parking end, thereby preventing a ve- 55 
hide touch accident in the backward movement. The to- 
top 46 causing the driver to make a check by the eye Is 
displayed for urging the driver to make a safety check 
by the eye during the executton of the parking assist 
process. Display of the telop 46 prevents such a dan- -«> 
gerous situatton that the driver is riveted to the display 
by the tnformatton display device 4 and gives less atten- 
tion to the environment Including the frontward and side- 
wand areas of the vehtole 1, which is not contained in 
the image displayed by the information display device 4. ^ 
[0271] Improvement oi the safety during the back- 
ward nr>ovement of the vehicle may be achieved in a 
manner that when the shift lever is shifted to the reverse 
gear positton, a vehtole speed is controlled to be below 
a predetermined speed. The speed control may be per- so 
formed also when the obstacle sensor, e.g.. the back 
sonar 17. detects an obstructive object 47. The control 
to limit the vehicle speed to betow a predetermined 
speed during the backward movement or the backward 
movement when the obstructive object is detected is ca- ss 
pable of preventing a vehtole collision during the back- 
ward movement and lessenhg an inpact at the time of 
the collision. 



[0272] Fig. 8 shows a scheme of a vehicle parking as- 
sist devtoe which is a second embodiment of the inven- 
tton. In the figure, like or equivalent portions are desig- 
nated by like reference numerals in the description of 
the first embodrnent. A camera unit 50 used in the sec- 
ond embodiment is designed such that its field 50a is 
varied by use of a rennote controller 51 . The camera unit 
60 ts attached to the rear part of the vehicle 1 . A t)ack 
light 52 for iltumtnating an area covered by the field 50a 
of the camera unit 50 at night is also used. The back 
light 62 is directed to the field 50a of the camera unit 50 
in accorcfertce with a remote control of the camera unit 
50 by the remote controller 51 . In the embodiment, a 
smooth parking nriay be secured by executing a throttle 
control 53 and a brake control 64 by the parking assist 
ECU 6, in addition to the parking assist by use of the 
information display device 4. Parking assist informatton 
using a predtotive traveling path curve 55a and gukte 
lines 55b is displayed on the screen of the infornr>atton 
display devtoe 4. 

[0273] A back light mounted on the vehtole 1 may be 
used for the back light 52. It is preferable that the back 
light 62 is optionally contained in the accessories of the 
camera unit 50. In parttoutar when a mechanism to 
change the Hluminatton direction is provided, optional 
use of it is easy. Where the illumination direction can be 
changed, the foltowing advantage is obtained: when the 
shift lever 8 of the transmission is shifted to the reverse 
gear positton. the back light 52 is turned downward to 
improve the visibility in a dark place, e.g., at night 
[0274] Fig. g shows an mage for a parking assist dis- 
played in the Fig. 8 embodiment. In the embodiment, 
the gukie lines 55b are curved in accordance with an 
image distort ton by a wtoe angle camera. For a camera 
of the camera unit 50, a wtoe angle lens is used for se- 
curing a field 50a as wide as possible. In the backward 
inrkage of the parking position 40 or the like, an actual 
straight portion is ptoked up as a curved image. Accord- 
ingly, the curving of the guide lines 55b in accordance 
with a distort ton of the image of the guide lines 55b will 
ensure a nnore exact parking etssist. 
[0275] When a part, e.g.. bumper, of the vehicle body 
of the vehtole 1 is contained in the ftekJ 50a of the cam- 
era unit 50. the vehicle body is more ctoser to this side, 
so that the body width of the vehicle 1 is larger than the 
distance between the guide lines 55b since the image 
is distorted. As for the predictive traveling path curve 
55a. if it is displayed having the wkith equal to the vehi- 
cle wtolh. when a part of the vehicle body is seen, the 
body wtoth of the vehicle appears to be larger than the 
gukie line distance in a regton near the vehtoto body, as 
in the case of the guide lines 55b. In the embodiment, 
when the predictive traveling path curve 55a and the 
guide lines 55b are displayed corresponding to the body 
width of the vehicle 1, the non<oinckJent portion near 
the body of the vehtole 1 is not displayed, and the driving 
for the non-coincident portion depends on the judge- 
ment of the driver. 
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[0276] For the non -coincident portion near the vehicle 
* body, the predictive traveling path curve 55a and the 
guide lines 55b rray be increased in width to be contin- 
uous to both sides o1 the vehicle body when those are 
displayed. Those widely displayed portions of the pre- 
dictive traveling path curve 55a and the guide lines 55b 
are wider than the actual vehicle body. Accordingly, if 
another vehicle and an obstructive object are not 
present in those widened portions, a more reliable safe- 
ty is secured. 

[0277] As described, above, the vehicle 1 may be 
parked in the camera unit 50 in a state that the steering 
wheel is positioned at the center position when the guide 
lines 55b are parallel to the sides of a vehicle being 
parked at another parkrig position or while lines drawn 
in the parking position 40. 

[0278] If the wkitK of the guide tines 55b is wkler than 
the body width of the vehicle 1 , a parking assist for pEirk- 
ing the vehicle 1 into the parking positk>n 40 is easier to 
understand. For example, the width of the guide lines 
55b is wkier than the actual vehble width by a fixed dis- 
tance. The vehicle may be parked in a state that the 
steering wheel is set h a straight drive stale in a manner 
that when the guide Ibies 55b lie on the white lines in 
the parking positkxi AO, tjoundary tines between it and 
the adjacent parking positions, or the sides of the vehi- 
cles being already parked in the adjacent parking posi- 
tions, the steering wheel is returned to the center posi- 
tion. Further, the width of the predictive traveling path 
curve 55 on the display may be selected in accordance 
with the cortdittons of the parking zone, whk;h is daily 
used by the driver. In the case of the daily used parking 
zone, a certain fixed distance may be a distance value 
suitable for the parking position 40. When the parking 
zone is not fixed in use, the certain fixed distance is a 
minimum value necessary for the opening/closing of the 
door, arxt the going in and out, so as to secure a space 
altowrig the driver to go out of the vehicle 1 . 
[0279] In Fig. 9, a line indfcaling a stop position 57 of 
the vehfcle 1 is displayed on the guide lines 55b near 
the vehicle 1 . In the backward image, a line is placed at 
a position apart from the rear end of the vehk^le 1 by a 
fixed distance. And when the line or the like of the park- 
ing frame of the parking position 40 reaches that posi- 
tion, the vehicle is stopped. The fixed distance is pref- 
erably selected to have such a distance as to avoid the 
touching of that the bumper or the like of the rear end of 
the vehicle 1 with an obstructive object, the car stopper, 
or the like and to be as short as possible, in order that 
the vehcte may be parked in a narrow parking space. 
[028O] Dotted lines are used to depict the guide lines 
55b on the display so as to be less notk»able than the 
predictive traveling path cun^e 55a- In other words, the 
predictive traveling path cun/e 55a is intensified in 
brightness. As a result, an easy-to-understand drive as- 
sist is provided to the driver The length of the guide lines 
55b may be varied while being interconnected in oper- 
ation with the back sonar 17. In a specific example, the 



length of the guide lines 55b is reduced according to a 
level of an alarm issued when the back sonar 1 7 detects 
an obstructive object 47. As a result, the driver gains a 
reference in measuring the vehicle moving distance, 

5 and may have a drive assist of actual drive feeling. 
[02S1] Fig. 10 shows a scheme of a vehk:le parking 
assist device whteh is a third embodiment of the inven- 
tkxi. In the enrkbodiment. a plan model 60 is provided to 
select a series parking mode for a series parking assist 

JO 61 or a normal parking mode for a normal parking assist 
62 on the screen of the information display device 4. In 
the normal parking mode, the field 50a of the camera 
unit 50 and the illumination by the back light 52 are di- 
rected rriainly to the backward area of the vehicle 1. In 

IS the series parking rrxxJe, the fieM 50a of the camera unit 
50 and the illumination by the back tight 52 are directed 
to the side of the vehble. 

[0282] The series parkrig nnode or the normal parki ng 
mode may be automatk^lly selected. The series park- 

20 ing mode may be selected when the turning on of the 
winker lamp 63 or the hazard lamp 64 and the shifting 
of the shift lever 8 to the reverse gear position are si- 
multaneously performed. In an sittemative, the driver re- 
fers to map data about the present pos ition of the vehicle 

25 1 , which is presented by the navigatfon device 1 5. When 
the present posrtk>n of the vehble is in the parking zone, 
the nonnal parking mode is selected. When it is on a 
road, the series parking mode is selected. In arK>ther 
alternative, a change of a steering angle of the steering 
wheel 7 is used to judge as to whether or not the parking 
mode is the series parking mode. In the series parking, 
it is frequent that the vehtele 1 is steered by a special 
steering operation, such as a reverse turn of the steering 
wheel. Typical steering patterns are stored into the stor- 

35 age menrxjry 29. When the present steerirtg patlem is 
coirx^ident with any of the stored ones, the process judg- 
es that the' series parking will be performed, arKf the 
process is designed such that the parking nxxJe is au- 
tomat caliy changed to the series parking mode. 

4o [0283] Fig. 11 is a diagram showing a fourth embodi- 
ment of the invention. In the embodiment, a plurality of 
camera units 10 are arranged around the body of a ve- 
hble 1. tnr^ges output from those canvera units 10 are 
simuRaneousty displayed on the same screen of the in- 

^ formation display device. As shown, the camera units 
1 0 are located at the front left L, the front right R and the 
back B of the vehbte 1. Each camera unit pbks up a 
scene within the fieW 10a thereof. 
[0284] Each of Figs. 12(1) to 12(12) exemplarily 

so shows segmented display areas formed by segmenting 
the screen of the information display device 4. The im- 
ages output from the plurality of the camera units 10 are 
stmuftaneously displayed in those display areas, re- 
spectively. Where those areas are used, all the images 

55 may be watched on one screen. In the example of Fig. 
1 2(1 ). the screen is se^ented in a time divisk>nal man- 
ner, and only the image of the t>ackward area is dis- 
played. The screen is automaticalty changed at fixed 
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time intervals to display other images. The displays may 
. be changed manually t)y the driver, but use of autonr^tic 
change of displays is suggestible since troublesome 
work to change the displays is eliminated, as a matter 
o1 course. s 
[028S] I n the example of Fig. 1 2(2), the screen is ver- 
tically segmented into two segmental display areas, 
right and left display areas. A front left image L and a 
front right innage R are displayed in those display areas, 
respectively. In the exanrrple of Fig. 12(3), the screen is io 
horizontally segmented into Iwo display areas, the up- 
per and lower display areas. The upper display area is 
further segmented into rl^t and left display areas, a 
front left L and a front right R. An image of the back B 
is displayed in the lower segmental disptey area. The 
example of Fig. 12(4) con-esponds to the vertk?ally in- 
verted Fig. 12(3) example. In the example of Fig. 12(5), 
images are displayed in the front left L and the front right 
R, which are located in the upper portkxi of the display 
area which displays an image of the back B. 20 
[0286] In the example of Fig. 1 2(6). the center of the 
upper skie of a screen and both ends of the tower side 
of the screen are connected by two straight lines, where- 
by the screen is segmented into three segmental display 
areas each shaped like a triangle. The front left L image 2S 
is displayed in the upper left display area; the front rIgM 
R inrage is displayed in the upper right display area; and 
the back B image is displayed in the remain ing displayed 
area. In the example of Fig. 12(7), the center of the tower 
side of a screen and both ends of the upper skJe of the 30 
screen are connected by two straight lines, whereby the 
screen is segmented into three segmental display areas 
each sftaped like a triangle. The front left L image is dis- 
played in the lower left display area; the front right R 
inrmge is displayed in the kwer right display area; and 35 
the back B image is displayed in the remain ing displayed 
area. The example of Fig. 12(8) resembles the example 
of the Fig. 1 2(6) except that the center of the upper side 
of the screen is connected to the center of the right and 
left sides of the screen by two straight lines. In the thus 40 
segmented screen, a display area in whtoh the back B 
innage is dfeplayed is enlarged when comparing with the 
con-esponding one in the Fig. 12(6) example. The ex- 
ample erf Fig. 12(9) resembles the example of the Fig. 
1 2(7) except that the center of the right and left sides of ^ 
the screen are connected to the center of the screen 
area by two straight lines. Also in this segmentatton, a 
display area in which the back B image is displayed is 
enlarged when comparhg with the corresponding one 
in the Fig. 12(7) example. so 
[0287] The example of Fig. 12(10) resembles the ex- 
ample of the Fig. 12(8) except that the lines demarcating 
those segmental display areas are curved downwardly 
or toward the display area of the back B image. The ex- 
ample of Fig. 12(11) resembles the example of the Fig. ss 
12(6) exceptthat the lines demarcating those segmental 
display areas are cuwed downwardly. The example of 
Fig. 1 2(1 2) resembles the example of the Fig. 1 2(6) ex- 



cept that the lines demarcathg those segmental display 
areas are curved upwardly. 

[0288] While the screen of the information display de- 
vfce is segmented as shown in Figs. 12(1) to 12(12) in 
the embodiment, it is readily understood that the screen 
may be segmented in other various ways. The display 
pattern is preferably changed in accordance with run- 
ning condittons of the vehicle. Specifically, the display 
pattern is automatk:ally selected in accordance with ve- 
hicle running conditions such that the display pattern of 
Fig. 1 2(2) containing two segmental display areas of the 
front left L and the front right R is selected for the normal 
running. For the backward running, any of the display 
patterns of Figs. 12(3) to 12(12) each containing three 
segmental display areas of the front left L, front right R 
and back B is selected. If so done, the display will easily 
understood by the driver. Alternatively, the side image 
display may be combined with the front image display 
or the back image display in accordance with the turning 
on of the winker lamp 63 by operating the direction in- 
dk:ator and a steering angle of the steering wheel. 
[0269] In a display of Fig. 1 3. a vehicle illustration 70 
is displayed on the display pattern of Fig. 12(3). The dis- 
play clearly shows a relative position of the vehicle 1 to 
the images from the camera units 10. With presence of 
the vehicle illustratton 70, the directk>n of the image is 
easy to understand. 

[0290] tt is preferable that, as shown in Fig. 14, a po- 
sitton of the vehicle illustration 70 is moved when the 
display pattern is changed to another. In the case of the 
time-divisional display pattern as shown h Fig. 12(1), 
as shown in Figs. 14(1) to 13(3), the positton of the ve- 
htote illustration 70 is moved to the upper center, kuwer 
ri^t and tower left positkx^ on the screen in accord- 
ance with the images of the back B, front left L and front 
right R If so done, the driver will easily understand which 
Innage is displayed. In the display pattern of Fig. 12(2), 
as shown in Fig. 14(4). the vehtole illustration 70 is 
moved to the center of the tower side of the screen. Ac- 
cordrigly. the driver will easily understand that the front 
left L and front right R images are disp^ed. 
[0291] In a display of Fig. 15, the vehicle illustratton 

70 Is displayed together with a camera image direction 

71 and a camera coverage 72. From this display, the 
driver will easily understand the camera unit 10 which 
ptoked up the innage being displayed. Further, an orien- 
tatkxi of the vehtole illustration 70 may be changed in 
accordance with a steering angle of the steering wheel 
7. In this case, a relattonship between the image Eind 
the advancing directton is readily seen. 

[0292] Fig. 16 shows a display pattern as shown in 
Fig. 12. In the display, a navigation display 41 by the 
navigation device 1 5 and an audio display 42 by the au- 
dto device 16 are both displayed on the same screen in 
a simplified fashion. This display fully utilizes the display 
screen of the hfomriation display devtoe 4, and is capa- 
ble of effectively providing informal ton necessary for the 
driver of the vehicle 1 or the like. 
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[02d3r| Fig. 17 diagranumtically shows a change of a 
. plurality- of displays by the wipe method. In the display 
changbng method, in a state that an image A is displayed 
on the entire screen of the information display device, 
the next innage B starts to shift from the left side to the 5 
right side on the screen. Accordingly, a Isoundary line 
between the image B and the image A moves to the 
rigtfit» and finally the image B occupies the entire screen. 
When the image A covering the entire screen area is 
instantaneously changed to the image 8. the driver is io 
difficult to follow a display change. However* in the em- 
bodiment, the driver is easy to follow the display change 
since the embodiment uses the wipe method for chang- 
ing the iirages from one to another. The display mode 
change l>y the viflpe method is applicable to the display is 
pallerns of Figs. 12(2) to 12(12)» as a matter of course. 
[0294] Fig. 1 8 diagramnrtaticalty shows how to change 
a segmented area and a disp^ position on a display 
pattern in accordance with a steering angle of the steer- 
ing wheel by the wipe method. The display pattern of ^ 
Fig. 1 2(3) is basically used. In the forward movement, 
the back B area is reduced. To turn to the left, the front 
left L area is increased, and to turn to the ri^t, the front 
leftR area is increased. In the backward rrwement, the 
back B area is increased. With this, the Image existing 
in the advancing directkMi is displayed while being em- 
phasized, thereby assisting a safety check. 
[0295] Fig. 19 shows a scheme of a vehicle parking 
assist device which is a fifth embodiment of the present 
inventk>n. In the embodiment, a multi-window is em- w 
pk>yed for the display by the information display devbe 
74. A touch panel is also empk>yed. A parking assist 
ECU 76 detects an obstructive object 47 by an obstacle 
serisor, such as a t>ack sonar 17 or a comer sensor 18. 
When the obstructive c^ject 47 is detected, the parking ^ 
assist ECU 76 infornns the driver or the like of the pres- 
ence of the obstructive object on the screen of the Infor- 
mation display devbe. 

[0296] Figs. 20A to 20C show how to change an ob- 
stacle display by a information display device 74 in the 40 
embodiment. Fig. 20A shows a display pattern of multi- 
window presented in a normal running mode or a park- 
ing assist nTKide. When an obstructive object is detected, 
the display is changed to an obstacle display as shown 
In Fig. 20B or 20C. In the obstacle display shown in Fig. 4S 
20B, a direction of an obstructive object 77 by use of a 
vehk^le illustration 70 and an arrow 78. When the ob- 
structive object is detected, a color of the obstacle dis- 
play nr>ay be changed to call the driver's attention. In an 
obstacle display shown In Fig. 20C, a display area for so 
displaying an rnage of the camera unit 10 which pfcks 
up an obstructive object is increased relative to the other 
display areas. An easy-to-see display is presented. 
[0297] Figs. 21 A arxi 21 B show a drive assist in which 
a plurality of camera units 1 0 are disposed, and the im- 55 
ages picked t>y the cameia units 10 are seamlessly 
composed into a single image. Three camera units 10 
are provided for picking up a prcture of a backward area 



of the veh icle 1 . The fiekJs 1 0l.a. 1 0Ba and 1 0Fta of the 
canr>era units partially overlap with one another. Fig. 21 B 
shows a display on the screen of the information display 
device 74 of the touch panel type as shown in Fig. 19. 
In the display, the images from three camera units 10L, 
1 0B and 10R are seamlessly composed by expanding/ 
reducing and cutting to form a continuous large image. 
[Q2!98] Figs. 22A and 22B show a display containing 
the images of the entire circumferential area of the ve- 
hkile 1. As shovOTi in Fig. 22A, six camera units 10F, 
10FU 10FR, 10B, 10BU and 10BR are disposed around 
the vehicle 1 to pick up a scene of the entire circumfer- 
ential area of the vehicle 1 . The images from those cam- 
era units 10F, 10FU 10FR, lOB. lOBL. and lOBRare 
composed and displayed on the screen of the informa- 
tion display device 74 as shown in Fig. 22 B. The driver 
looks the display and makes a safely check on the entire 
circumferential area of the vehicle. Further, when cou- 
pled with the back sonar 17 or the corner sensor 18. it 
Is possible to display an alarm tekp or to change a color 
of the display con^ponding to the direction in whKh the 
obstructive object is detected. 

[0299] In the display patterns of Figs. 21 B and 22B, a 
multiple of images are displayed on the same screen 
simultaneously. Accordrigly, one ora plurality of rnages 
may be selectively displayed. The selectbn may be per- 
formed by operating a switch by a driver or automatically 
performed in accordance with running condftk>n3. Such 
a design as to continuously check a broad area by scroll- 
ing the display is possble. The informatk>n display de- 
vice 74 alk>ws the driver to enter instructtons and the 
like through the touch panel. Specifically, the driver 
touches a desired image on the display of Fig. 21 B or 
Fig. 22B. and enlarges the selected image. Accordingly, 
the driver checks a desired location in easy and prompt 
manner. It is preferable to retum the promptly enlarged 
image to the original size. By so doing, the work by the 
driver to return the image size to the original one may 
be eliminated. 

[0300] Fig. 23 shows a scheme of a vehicle parking 
assist device which is a seventh embodiment of the in- 
ventk>n. In the embodiment, a front monitor camera 80 
is attached to the front part of the body of the vehicle 1 . 
A roof camera 81 is also attached to the roof as the high- 
est part of the vehtele body. A parking assist ECU 84 
has an arrangement substantially the same as of the 
parking assist ECU 6 shown in Fig. 3, and it carries out 
a drive assist process by the utilizatkxi of the front image 
picked up by the front monitor camera 80. A navi^k)n 
devfce 85 includes a memory for storing an innage of a 
scene of the front area of the vehicle, which is ptoked 
up by the front monitor camera 80. This may be utilized 
for detecting traffic congestion. The fetched image is 
wirelessty transmitted to a traffic control center located 
near a position where the vehicle 1 is located, by use of 
the navigatk>n device 85. In this way. a broad drive assist 
is performed. The enage picked up by the front monitor 
camera 80 is also displayed by the infornrtation display 
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device 4, and the driver uses it to make a safety check. 
. [0301] • The f rcxit monitor camera 80 may also be used 
for a camera for detecting the preceding vehicle. When 
a vehicle runs in front of the vehicle 1 when viewed in 
the advancing direction, a vehicle-to- vehicle distance 5 
tong enough to avoid a rear-end collision must be se- 
cured. If the fnont nrK>nitor camera 80 has the furtctkxi of 
the preceding-car detecting camera, the drive assist and 
preceding-car detecting functiorw are realized at tow 
cost. The front monitor camera 80 may be used for a io 
camera for monitoring a vehicle which forcibly runs to in 
front of the self vehicle. When another vehicle forcibly 
runs to in front of the vehicle 1 . the driver must take a 
measure for prevent a rear-end collision. If the front 
monitor camera 80 has the funclton to monitor such an 
interruptive vehicle, the drive assist function and the 
functkxi to detect the interruptive vehicle are realized at 
low cost 

[0302] The roof camera 81 picks up the front area 
scene from the vehkde roof as the highest posit ton of 20 
the vehicle. When the vehicle 1 passes under an over- 
head bridge, the driver makes a check as to if the pass- 
ing of the vehicle is permitted, when a height Iknit is pro- 
vided, tn this case, the driver judges if the vehtole pass- 
ing infringes the height limit regulatk>n. from a view of 25 
the upper limit portion where it will pass. 
[0303] Fig. 24 shows displays when a brightness of 
the display by the information display device 4, 74 is 
changed between the forward movement and the back- 
ward movement in each embodinnent. In the backward w 
moverrient shown in Fig. 24A, the entire screen is bri^t 
to provide an easy check of the parking position 40 and 
the predictive traveling path cun^e 5a. 55a. In the nonnal 
running shown in Fig. 24B, the screen is relatively dark. 
In this case, the driver must watch the front area atten- 3S 
tively, and it is better that the driver tums his attention 
out of the screen of the infornr>atton display devtoe. It is 
for this reason that the screen is set to be relatively dark. 
If the screen is relatively dark, it is easy to call driver's 
attention by changing the color of the screen to a bright 40 
color when such a situatton occurs. In the backward run- 
ning, the screen is bright so that the driver may watch 
the details. 

[0304] Fig. 25 shows a display containing a display 
frame 87 of a back mirror From the display, the driver 4S 
can easily understand a t>ack image when the t>ack im- 
age is displayed. The back image displayed within the 
display frame 87 is corrected to have a fiekJ angle of the 
back mirror, by a correction in^age processrig of cutting, 
enlarging^reducing. whereby the display is transformed so 
Into a display fit to the driver's feeling of the inrage on 
the back mirror. In particular when a wide angle camera 
is used, this correctton is needed since the driver hardly 
grasps the sense of distance because of the inr^ge dis- 
tortion. 55 
[0305] Fig. 26 shows a basic arrangement for a drive 
assist in eighth to 11th embodiments of the present in- 
vention. Whenadrrverofavefiicle 101 moves backward 



his car to a parking zone 1 02 and parks the car there, a 
vehtole drive assist device visually presents an iimge 
of a dead space for the driver and assists the driver in 
his driving on the screen of an infornnation display devtoe 
104. A backward area image of the vehtole and a pre- 
dtotive traveling path cun^e 1 05 are displayed so that the 
driver can correctly park the vehtole in a parking space 
marked off with white lines 103 or the like as a target. 
The information display device 1 04 may be a liqukJ crys- 
tal display device (LCD). The infonnatton display device 

104 displays a drive assist image, whtoh is generated 
by a parking assist ECU 1 06 as an electron to control unit 
(ECU) for drive assist. A steerage or steering angle of 
a steering wheel 107 is input to the parking assist ECU 
106. In turn, the ECU 106 catoulates a predtotive 
traveling path curve 105 based on the steering angle, 
and the catoutated predtotive traveling path curve 105 is 
displayed on the screen of the inforrr^tion display de- 
vtoe 104. 

[030q The parking assist ECU 106 starts the supply- 
ing of drive assist information in response to, for exam- 
ple, a shifting operation of a shift lever 108 of the Xtbhs- 
misston to an R positton for backing the vehtole. The 
drive assist informatton is supplied in the form of image 
informatton by the information display devtoe 104 and 
acoustto informatton by a speaker 109 as well. 
[0307] A scene of a backward area of the vehicle 1 01 
when the vehicle 101 backs is ptoked up by a camera 
unit 110. The camera unit 1 1 0 is installed at the rear part 
of the vehtole 101 so that its fieM 110a ts directed to the 
road 102 when the vehtole 101 moves backward. Comer 
sensors ill. 112, 113and 114 are provided around the 
vehtole 101 , for example, at the four comers of the ve- 
htole. Those sensors serve as obstacle sensors for de- 
tecting obstructive objects at the comers of the vehicle 
by using a ultrasonic wave. 

[0308] Fig. 27 is a diagram showhig a state that the 
vehtole 101 of Fig. 26 backs into a parking space indi- 
cated by the white lines 103 in the partying zone 102. 
The C£imera unit 110 mounted on the rear part of the 
vehtole 101 picks up a scene of an area within the ftekl 
1 10a. The area within the field 1 1 0a is so selected as to 
contain portior^, which are each within a dead angle to 
the driver to the vehtole 101, as many as possible. A 
steering angle of the steering wheel 107 is detected by 
a steering angle sensor 115. A backward nrtovement of 
the vehtole is detected as an on state of a back lamp 
SW signal 116 output from the transmission. 
[0309] The parking assist ECU 1 06 responds to a vkJ- 
eo signal of the NTSC system from the camera unit 110, 
a pulse signal corresponding to a turn of a steering an- 
gle, whtoh is output from the steering angle sensor 107, 
and a back-lamp SW signal 1 1 6 for driving a switch (SW) 
of a back lamp whtoh is tumed on when the vehtole 
backs, and displays a predtotive traveling path cur^e 

105 of the vehicle 101 and a three-dimensional image 
generated along the predtotive traveling path curve 105 
on the screen of tiie information display devtoe 104, 
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thereby making a parking assist 
.[031O] • Fig. 28 electrically shows the innards of the 
parking assist ECU 106 shown in Fig. 26. The parking 
assist ECU 106 contains a digital signal processor 
(DSP) 1 20 for carry rig out an overall control ar^ cateu- 5 
lattons. Peripheral circuits are connected to the DSP 
120 by a bus 121 . A video signal from the canr^era unit 
110 is input in the fomn of a corrposite video signal of 
the NTSC system to an amplifier/filter circuit 122. The 
amplifier/filter circuit 1 22 selectively annplifies an anatog io 
video component contained in the composite video sig- 
nal. The output signal of the amplifier/filter circuit is ap- 
plied to an anatog to digital (ADC) 1 23 where its analog 
signal form is converted into a digital form. The thus dig- 
itized video signal is then stored into a fieW buffer circuit v. '5 
124. The output signal of the amplifier/filter circuit 122 
is also applied to a sync separation circuit 125 which in 
tum separates a horizontal sync signal and a vertical 
sync signal from the composite video signal. Those sync 
signals are input to the DSP 1 20. An angular displace- 20 
ment detect signal, output from the steering angle sen- 
sor 11 6» whrch represents a steering angle of the steer- 
ing wheel 107, is input to the DSP 120 by way of a buffer 
circuit 126. A center positk>n detect signal generated 
when the center positkxi of the steering wheel 107 is 25 
detected is also input to the DSP 120 through the buffer 
circuit 126. Further, obstacle detect signals derived from 
the comer sensors 111 to 114, and a back lamp SW sig- 
rral are also input the DSP 120. through the buffer circuit 
126. 30 
[0311] The DSP 120 operates in accordance with a 
program prestored in the program meiTX>ry 127. whrch 
is connected thereto by the bus 1 21 . Data necessary for 
an operation based on the program of the program 
memory 1 27 is stored in advarx^e in a data memory 1 28. 3S 
The DSP 120 carries out a recognition process of the 
white lines 1 03 and the like in response to the video sig- 
nal input thereto, and catcu tat ions for generating a pre- 
dictive traveling path curve 1 05 according to an angular 
displacement operation of the steering wheel 107. The -«> 
generated innage is stored into fteki buffers 1 31 and 1 32, 
either of which is selected according to an output signal 
ol an SW circuit 130. Either of the fiekJ buffers 1 31 and 
132 is selected by the SW circuit ^30, and an output 
signal of the SW circuit is output as an fMTSC video sig- <5 
nal to the information display devk^e 104, by way of a 
digital to analog converter (DAC) 1 33 and a fillerMmpli- 
fier circuit 134. Electrk; power is supplied from a power 
supply 135tothe whole parking assist ECU 106. Areset 
circuit 1 36 supplies a reset signal to the parking assist so 
ECU 1 06 to reset the latter to an initial state, and starts 
its operation according to the program. A CLK/frequen- 
cy demultiplying circuit 1 37 supplies a clock signal de- 
fining a reference timing of the operatk>n of the parking 
assist ECU 106. and signals formed by demultiplying a 55 
frequency of the clock signal. 

[031 2] Fig. 29 is a diagram roughly showing a display 
ol a parking assist image in the eighth emlxxJiment of 



the invention. In the embodiment, rectangular planes 

140. 141. 142 which depends on the height of the 

vehble, are arrayed at fixed distances (e.g.. Im) along 
a predictive traveling path curve 105 in the display. Of 
those planes 140. 141. 142. .... the plane a41 is based 
on a case where the vehk^le approaches to an obstruc- 
tive object sensed by the comer sensors 11 1 and 1 1 2 of 
the rear part of the vehicle, and it has a color different 
from those of other planes 140 and 142. 

[0313] Fig. 30 is a fk>w chart showing a drive assist 
procedure executed by the parking assist ECU 106 n 
the Fig. 29 embodiment. The drive assist procedure 
starts at a step al. In a step a2. the parking assist ECU 
106. more exactly DSP 120, checks if a parking assist 
mode is set up. When the back lamp SW signal 11 6 input 
thereto is in an on state, the DSP judges that the parking 
assist mode is set up. In a step a3. a steering angle is 
detected from an angular displacement detection signed 
of the steering angle sensor 115. In a step a4. a predk:- 
th^e traveling path curve 105 is calculated from a steer- 
ing angle. In a step a5, the cabulated predictive 
traveling path curve 105 is super omposed on the back- 
ward area image output from the camera unit 110. In a 
step a6, an ot>stacle detecting operation by the comer 
sensors 111 and 112 attached to the rear part of the ve- 
htele is carried out. The comer sensors 111 and 112 ra- 
diate ultrasonic waves toward an obstructive object, and 
an obstructive object is detected on the basis of pres- 
ence or absence of ultrasonic waves from the obstruc- 
tive ot>ject. A distance from the vehrcle to the obstructive 
object is measured on the basis of a time duration from 
an instant that the ultrasonic wave is transmitted till it is 
received. In a step a7. distances for presenting the 
planes 140. 141 and 142 as shown in Fig. 28 are initial- 
ized. 

[0314] In a step a8, a fixed distance "d". e.g., Im is 
added to the distance. In a step a9. one of the rectan- 
gular planes 140. 141. 142. ... is displayed on the pre- 
dtetive traveling path curve con-esponding to the dis- 
tance. Those planes 140. 141, 142, ... are displayed ver- 
tical to the ground. A step alO checks if the positions of 
the planes 140. 141. 142. ... arectose to the positkxi of 
the obstructive object 150 whk;h is detected in the step 
a6. When the positions are dose to the ot^stacle posi- 
tkxi. a step all changes the cotors of the planes 140. 

141 , 142. ... to be displayed from those of the planes 
140. 141. 142, ... al other positions toother ones. When 
those plane positk>ns are not ck>se to the obstacle po- 
sitk>n in the step alO, or when the cok>r change in the 
step ail is completed, a step al 2 checks n the distance 
reaches the final position. The final position of the dis- 
tance is set in advance. When the distance does not 
reach the final |X>sition, the DSP returns to the step a8 
in its procedure executbn. When the step a12 judges 
that the distarrce reaches the final position, the DSP re- 
turns to the step a2. and repeats a sequence of proce- 
dure steps a2to a12. 

[0316] When completing the parking operation by 
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backing the vehicle, the driver shifts the shift lever 108 
to a P position for parking. Accordingly, the back lamp 
SW signai 116 is in an off state, and the parking assist 
mode terminates. When the step a2 judges that the ve- 
hicle is r>ot in the parking assist mode, the parking assist 
operation ends in a step a2. 

[031 6] Fig. 31 is a diagram showing an image for park- 
ing assist whfch is the ninth embodiment of the inven- 
tion, tn this embodiment, a plane 140 displayed akxig 
the predictive traveling path curve 105 is displayed at a 
positic^ where the obstructive object 150 is detected. 
The plane 140 is a rectangular in shape, and its height 
corresponds to the height of the vehfcle 101. Therefore, 
the heic^t of the vehicle 101 relative to the obstructive 
object 1 50 can be recognized, and hence the driver can 
check a possibility that his vehicle will touch the obstruc- 
tivQ object 150 and a touching positkxi when it touches 
the object. 

(031 7] Fig. 32 is a fksw cfiart showing a control proce- 
dure executed by the parking assist ECU 106 in the Fig. 
31 embodiment. The control procedure starts at a step 
b1 . Steps b1 to b6 correspond to the steps al to a6 in 
Fig. 30. In a step b7, a plane 140 is displayed on the 
predictive traveling path curve 105 located close to the 
obstructive object 1 50 detected in the step b6. When the 
plane display in the step b7 ends, the DSP retums to 
the step b2 in its procedure executk>n, and repeats a 
sequer^ of the steps b2 to b7. When the step b2 judges 
that the parking assist mode ends, the DSP completes 
the procedure control in step b8. 
[031SI Fig. 33 is a diagram showing a parking assist 
image which forms the tenth embodiment of the inven- 
tion. In the embodiment, the rectangular plane 140 of 
whk;h the height corresponds to that of the vehicle 
nfx>ves along the predictive traveling path curve 105. 
The cokx of the plane 1 40 is changed at a posit bn close 
to the obstructive object 150 from that of the plane at 
other positions. Also in the embodiment the height of 
the vehkJie 101 can be recognized, and a possibility of 
the backing vehicle with the obstaictive object 1 50 in the 
parking space can be checked. 

[031 9Q Fig. 34 is a fk>w chart showing a control proce- 
dure of the parking assist ECU 106 in the Fig. 33 em- 
k)od'ment. The control procedure commences at a step 
cl. A control sequence from steps c1 to c7 is equivalent 
to the control sequence from the steps al to a7 in Fig. 
32. In a step c8. a distance Ad as a distance unit of the 
plane 1 40 in the display is added to the distance. A value 
of the unit distance Ad is selected to be smaller than the 
fixed distance 'd" in the Fig. 28 embodiment. In a step 
c9, a plane 140 is displayed at the distance position. A 
step clO checks if the posttran at whk*i the plane 1 40 is 
close to the obstructive object 150. When the answer is 
YES, a step cll changes the color of the plane 140 to 
another color. When the answer is NO in the step clO, 
or when the cofor of the plane 1 40 is changed in the step 
cll , a step c12 checks if it reaches the final positk>n. At 
this final position is equivalent to that judged in the step 



al 2 in Fig. 30. In a step c1 3» the DSP deletes the plane 
1 40 displayed in the step C1 3. and returns to the step c8. 
[0320] Subsequently, the plane 1 40 is displayed eve- 
ry unit distance Ad. and is nnoved along the predkittve 

5 traveling path curve 105 till a step c12 judges that it 
reaches the final posit bn. When judgement is made 
such that the vehk:le is close to the ot>structive object 
160 during its nrwvement. the color of the plane 140 is 
changed. When the step c12 judges that it reaches the 

10 final posit ion» the DSP returns to the step c2, and re- 
peats a procedure sequence from the steps c2 to c13. 
When the step c2 judges that the parking assist mode 
ends, the control procedure ends in a step c14. 
[0321] In the Fig. 33 embodinrkent. the color of the 

IS plane 1 40 is changed at a positkxi near the obstructive 
objec* 150. If required, the plane 140 may be stopped 
at a position cbse to the obstructive object 150. The dis- 
play of the plane 1 40 may be stopped in a manner that 
the movement of the plane 1 40 is stopped in the step cll 

^ of Fig. 34, in place of the changing the color of the plane 
140. In each of the Figs. 29. 31 and 33 embodiments, 
one or more number of the rectangular plemes 140. 141 , 
142. ... which depend on the vehicle height. Alternative- 
ly, a projection plane of the vehicle may be displayed 

25 vertically to the ground. Where the projective plane of 
the vehicle is displayed, more practical check is made 
about the possibility of the touching of the vehk^e with 
the ot>structive object. 

[0322] Fig. 35 is a diagram showing a parking assist 

5a display as the 11th embodiment of the invention. In the 
embodinrtent. a backward moving vehfcle 101 is illustrat- 
ed in a 3-dinr^nsk>nal simulation. A simulation image 
1 51 of the vehicle 101 is generated according to a con- 
figuration of the vehicle 101 stored in the data memory 

^ 1 28. When the parking assist display is used, the driver 
can check, in a simulation manner, a possibility that the 
vehfcle will touch an obstructive object kx:ated near the 
parknig space while moving the vehk^le akxig the pra- 
dtetive traveling path curve 105. 

40 [0323] Fig. 36 is a flow chart showing a control proce- 
dure of the paricing assist ECU 106 for ihe Fig. 35 em- 
bodiment The control procedure commences at a step 
dl. arxl a procedure sequence from steps dl to d8 is 
equivalent to that from the steps c1 to c8 in Fig. 34. In 

^ a step d9. a simulation image 151 is displayed rt place 
of the plane 140 in Fig. 30. A subsequent procedure se- 
quence to a step d1 3 is equivalent to the sequence from 
the steps c9 to c1 3 ri Fig. 34, except that the sequence 
is directed to the stmutetion inr>age 151 in place of the 

50 plane 140. 

[0324] In the embodiments descrit>ed above, the cor- 
ner sensors 111 and 112 are used for the obstacle sen- 
sors. Those ser^rs may be substituted by a back ^>nar 
using ultrasonic wave, a radar using etectromangetk: 

55 wave or laser beam. An obstructive object may be ex- 
tracted from the innage picked up by the camera unit 110 
by use of the image process rig technk|ue. In the em- 
bodiments, the colors of the planes 140. 141, 142, ... 
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and the snmulation image 151 are changed at a position 
» closer to the obstructive object 1 50. Instead of the color 
change, flashing may be used for distinguishing it from 
other positions. 

[0325] While the parking assist has been descrtoed 
when the vehicle 101 is backed into the parking space, 
the same thing is correspondingly applied to the parking 
assist when the vehicle 101 ts advanced into the parking 
space. It is evident that the technical kiea of each em- 
bodiment may be applied to the parking assist when the 
vehicle travels in a path where the visibility is bad. 
[0326] Fig. 37 is a diagram showing a vehicle 201 un- 
der dris^e assist which is nrvoving to a parking space in a 
1 2th embed ament of the present invention. When the ve- 
hicle 201 backs to a parking zone 202 and is to be 
parked hi a parking space nr>arked cii with white lines 
203. image informatkxi for parking assist is displayed 
on the screen of an infonmation display device 204. The 
parking assist image informatkxi contains a predictive 
traveling path cun/e 205 which is calculated on the basis 
ot the prediction of a traveling path of the vehicle. The 
predictive traveling path curve 205 is calculated de- 
pending on a steerage or steering angle of a turn of a 
steering wheel 207 of the vehk>te 201 . by a parking as- 
sist ECU 208 as an electronic control unit for parking 
assist. The parking assist ECU 206 starts a control for 
drive assist when a shift lever 208 of the transmission 
is shifted tea reverse gear position, for example. A guide 
for parking assist in the parking operation is also acous- 
tically carried out by use of a speaker 209. 
[0327] When the driver backs his vehicle into a park- 
ing space, a backward area of the vehicle is the dead 
space when viewed from the driver of the vehicle 201 
and hence he ir^ufficiently sees the background area. 
To cope with this, a cannera unit 210 is attached to the 
upper rear part of the body of the vehicle 201 so that its 
field 210a covers the parking zone 202 which forms a 
dead angle for the driver A scene of the paricing zone 
202 is picked up by the camera unit and displayed on 
the screen of the inforrratbn display device 204. 
[0328] Fig. ^ is an electrical arrangement when the 
driver backs the vehk^le 201 of Fig. 37 to the parking 
zone 202 and parks It there. A vWeo signal <^ the NTSC 
type is input from the camera unit 210 to the parking 
assist ECU 206. A pulse signal is also input to the park- 
ing assist ECU every fixed steering angle, from a steer- 
ing angle sensor 211 for detecting a steering angle of a 
steering wheel 207. When the shift lever 208 is shifted 
to the reverse gear position, a back-lamp SW sigr>al 212 
which turns on a switch (SW) to tum on a back lamp is 
produced and input to the part<ing assist ECU 206. 
When the back-lamp SW signal 21 2 is put to an on state, 
the parking assist ECU 206 starts a parking assist nec- 
essary for the vehicle to back into a parking space. In 
the parking assist operation, a predictive traveling path 
curve 205 which depends on a steering angle detected 
by the steering angle sensor 211 is calculated, and over- 
lafcl on the image of the backward area picked up by the 



camera unit 21 0 on the screen of the intormatton display 
devtee 204. 

[0329] Fig. 39 is an electrical arrangement of the park- 
ing assist ECU 206 shown in Fig. 37. In the parking as- 

s sist ECU 206, an overall control is performed by a digital 
signal processor (DSP) 220. TTie DSP 220 periomns 
controls and signal processings through a bus 221 . The 
came ra unit 2 1 0 inputs a video signals of the NTSC type 
to the parking assist ECU. The video signal is amplified 

10 by an Eunplifier/Tilter circuit 222. A signal form of the vide 
component signal is converted into a digital form by an 
digital converter (ADC) 223. The digitized video signal 
is stored in a field buffer circuit 224. The video signal is 
also applied from the amplifier/filter circuit 222 to a sync 

15 separation circuit 225. In the sync separatkxi circuit, the 
horizontal and vertical sync sigrtals are separated from 
the video signal and are input the DSP 220. An angular 
detect signal representative of an angular displacement 
of the steering wheel is applied to the DSP 220. from 

^ the steering angle sensor 211 . A center positton detect 
sigr^al indicating that the steering wheel 207 is at the 
center positkxi is also applied to the DSP 220. throu^ 
the bus 221. 

[0330] The DSP 220 operates in accordarKe with a 

25 program prestored in the program men^ory 227 connect- 
ed thereto by way of the bus 221. Under control of the 
program, the DSP 220 carries out calculation processes 
and performs control operatk^ns, while referring to data 
preset in the data menrK>ry 228 and storing data pro- 

30 duced during the cateulation. The DSP 220 recognizes 
the white lines 203 shown in Fig. 37 r» accordance with 
the vkJeo signal input thereto and generates an image 
of a predk^tive traveling path cun^e 205. which depends 
on a steering angle of the steering angle sensor 211. 

35 [0331] The generated image is stored into field buffers 
231 and 232 each of which is selected by a SW circuit 
230. The rnage signal is selected by the SW circuit 230, 
and the selected one passes through a digital to analog 
converter (DAC) 233 and a filter/amplifier circuit 234. 

<o and goes as a video output signal to the information dis- 
play device 204. Electrk; power is supplied from a power 
supply 235 to the whole parking assist ECU 206. The 
DSP 220 receives a reset signal to the DSP from a reset 
circuit 236, and a ctock signal which defines a baste op- 

^ eratkxi timing from a CLK/Trequency demultlplying cir- 
cuit 237 and signals having the frequencies produced 
by demultiptying the frequency of the ckx:k signal. 
[0332] The parking assist ECU 206 includes a voice 
data memory 238 and a votee connposing circuit 239. 

so With proviston of those, the parking assist EC U 206 car- 
ries out a drive guide by a voice. To the votee guide, the 
DSP 220 selects voice data from those stored in the 
voce data memory 236 in accorc^nce with gukie con- 
tents, and applies the selected one to the vobe com- 

55 posing circuit 239. The voice data applied to the voice 
conrkposing circuit 239 is digital data encoded according 
to a predetermined encoding n>ethod. The voice com- 
posing circuit 239 decodes the voice data and converts 
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ft into an analog voice signal. The analog voice signal 
. output f com the voice composing circuit 239 is output in 
an acoustic form by a speaker 209, whereby the vehrcle 
drive assist device acoustically assists the driver rt his 
driving. 

[0333] Fig. 40 is a flow chart showing a control proce- 
dure for parking assist, whteh is carried out by the park- 
ing assist ECU 206 in the 12th embodiment. The control 
procedure commences at a step a1 . In a step s2. the 
parking assist ECU 206, more exactly the DSP 220, 
checks if a back-lamp SW signal 212 is in an on state. 
When the back-lanrp SW signal 212 is in an on state in 
the step s2, a parking assist nrode is started. In a step 
s3. an alarm of causing the driver to visually watch en- 
vironmental condttk>ns around the vehicle is issued 
acoustically. A backward area scene of the vehicle 201 
is picked up by the camera unit 210 and displayed on 
the screen of the information display device 204. The 
driver is required to watch attentively the front and side 
areas of the vehicle 201 . whfch are not displayed by the 
information display devk;e 204. The acoustic alarm is 
given to prevent the driver to watch only the screen of 
the information display devk;e 204. An example of the 
acoustic alarm is a sound message 'Watch the environ- 
ment in t>acktng the car'. 

[0334] In the next step s4, the backward area image 
picked up by the camera unit 210 is displayed on the 
screen of the information display devbe 204, and in a 
step 65, a steering angle is detected by an angular dis- 
placement detect signal derived from the steering angle 
sensor 211. In a step s6, a predictive traveling path 
curve 205 b calculated depending on a steering angle 
detected, and is overlaW on the backward area image 
on the screen of the information display device 204. In 
a step s7. a target parkoig position is detected from the 
image pk;ked up by the camera unit 210. It is required 
thai the target paricing position detected meets the con- 
ditKMis that it is the parking space marked off with the 
while lines 203, and that it has an area large enough to 
park the vehicle. 

[0335] Inastep s8. the DSP checks if the target park- 
ing position detected in the step s? lies on the predictive 
traveling path cunre, whch is cateulated in the step s6 
depending on a steering angle detected in the step s5. 
When the target parking position is not on the predk:tive 
traveling path curve, a step s9 cak:utates a target 
traveling path from the present position to the target 
pEurking position. The DSP judges if a steering angle that 
will produce the target traveling path is within a range 
within which the steering wheel 207 may be turned, on 
the l>asis of a difference between the target traveling 
path and the actual predictive travefing path curve 205. 
When it is judged that the steering angle may be adjust- 
ed by varying the steering angle so as to satisfy the tar- 
get travelrig path, a step slO carries out a steering guide 
atx)ut a direct kxi and a angle of a tum of the steering 
wheel 207 on the basis of a steerrig angle calculated 
for matching an actual steering angle to the target 



traveling path. The steering gukJe nrey take the fonm of 
a display of character infomnatk>n, e.g., telop on the 
screen of the information display device 204 or avoice 
message tum more to the right (left)'. Folbwtng the 

5 step si 0 of the steering guide, the DSP returns to the 
step s5 in executk>n of the control procedure. When the 
driver varies the steering angle, the drive assist for the 
steering guide is performed through a sequence of the 
steps s5 to si 0 till the steering angle to produce the tar- 

10 get traveling path is reached. 

[0336] When the step 68 judges that the target parking 
position lies on thepredk^tive traveling path curve, a step 
sll judges that the vehicle will touch an obstructive object 
when the vehicle 201 t>acks along the predictive 

IS traveling path curve 205. When the vehicle does not 
touch the obstructive object, a step si 2 judges if a park- 
ing stopper exists in the target parking position. If the 
stopper exists, a step si 3 presents a gukle tfmt the stop- 
per is preset by a display by the intonTiatk>n display de- 

20 vfce 204 or by avoice. Thus, when the driver is Informed 
of preserve or absence of the parking stopper, he may 
refer to it in his braking operation when he backs the 
vehrcle. 

[0337] When the step 69 judges that the vehicle can- 

2S not run into the target parking positk)n by the steering 
operation or when the step slf Judges that the vehicle will 
touch the ot)structive object on the predictive traveling 
path curve, a step si 4 presents a guide to reverse the 
advancing direction of the vehicle. The guide of revers- 

30 ing the advancing direction is given by a display by the 
tnforrr^tk^n display devk^e 204 or a voice. The guide is 
such that you cannot parte the vehfcle if the vehicle will 
t>e moved backward, and to park the vehicle, you must 
move the vehicfe forward and reversely tum the steering 

35 wheel 207. 

[0338] When the step s2 judges that the back-lamp 
SW si^al 212 b not in an on state, when the step si 2 
Judges that the parking stopper is not present, or when 
the guide ends in the step si 3 or sl4, the control pio- 

40 cedure ends at a step si 5. When the driver moves his 
vehkile forward after the step si 4 of the advancing-di- 
rectfon reverse guide, the DSP continues the operatk)n 
of detecting the target partcbg position on the backward 
area image, and cak^ulates a target traveling path from 

^ the present posit fc)n to the target parking position. The 
gukJe may be made to inform the driver of the timing of 
reversely turning the steering wheel 207 when it is con- 
firmed that the time to produce the target traveling path 
at a steering angle through whfch the steering wheel 207 

^ may be turned is reached and the vehkHe does not touch 
the obstructive object on the target traveling path. 
[0339] While the parking assist has been described 
for a case where the driver backs the vehicle hto the 
parkrig zone 202. the parking assist may be corre- 

55 epondingly applied to a case where the vehicle 201 
moves forward into the parking lot. In this case, a scene 
of the fonward area of the vehk;le is picked up, and a 
target parking positbn is detected. In the 12th emtjodi- 
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ment mentioned above, the steering guide» stopper 
. preser>ce/absence guide and the advancing-direction 
guide are carried out in the steps slO. 13 and 14. re- 
spectively. If occasion demands, one of those guides or 
a combBiation of them may selectively be used. s 
[034O] While a display by the informatfon display de- 
vice 204 and a voice by the speaker 209 are both used 
for the guide for the parking assist in the 12th emtxxJi- 
ment mentioned above, one of the visual and acoustic 
guides may be used, as a matter of course. io 
[0341] Fig. 41 shows a bask; arrangement for a drive 
assist in 1 3th to 1 8th embodiments of the present inven- 
tion. When a driver of vehicle 301 a moves backward 
his car to a parkbig zone 302 and paries the car there, a 
vehicle pari^ing assist device visually presents an image is 
in a dead space for the driver and assists the driver in 
his driving on the screen of an hformatkxi display device 
304. A backward area image and a predictive traveling 
path cun^e 305 are also displayed so that the driver can 
correctfy parte the vehfcle into a parking space marked 20 
off with white lines 303 or the like as a target. The infor- 
mation display device 304 may be a liquki crystal display 
devbe (LCD). The information display devk^e 304 dis- 
plays a drive assist image, whk^h is generated by a park- 
ing assist ECU 306 as an electronic control unit (ECU) 2^ 
for drive assist. A steerage or steering angle of a steer- 
ing wheel 307 is input to the parking assist ECU 306. In 
turn, the ECU 306 calculates a predictive traveling path 
curve 305 based on the steering angle, and the cak;u- 
lated predictive traveling path cu rve 305 is displayed on 30 
the screen of the infomration display device 304. 
[0342] The partcng assist ECU 306 starts the supply- 
ing of drive assist information in response to. for exam- 
ple, a shifting operation of a shift lever 308 of the trans- 
m^ton to an R position for nrovhg the vehicle back- 35 
ward. The drive assist informal k>n is supplied in the form 
of visual or image informatics* by the inforrration display 
devk» 304 and acoustic infomnatkxi by a speaker 309 
as well. A scene of a t>ackward area of the vehfcle 301 
when the vehfcle 301 backs is picked up by a camera <o 
unit 31 0. The camera unit 31 0 is installed at the rear part 
of the vehicle 301 so that its field 31 Oa is directed to the 
parking zone 302 when the vehicle 301 moves back- 
waid. A steering angle of the steering wheel 307 is de- 
tected by a steering angle sensor 11 . A shifting opera- 45 
Won of the shift lever 308 to the reverse gear position is 
judged according to a back-ianr^ SW signal 312 as an 
on/off signal applied to a switch (referred to as an SW) 
for controlling a lighting condition of a back lamp. 
[0343] Fig. 42 is a diagram showing a state that the so 
vehfele 301 of Fig. 41 t>acks to a parking space n^arked 
off with while lines 303 in the pariung zone 302. The 
camera unit 310 mounted on the rear part of the vehicle 
301 picks up a scene of an area within the field 310a. 
The area within the field 31 Oa is so selected as to con- ss 
tain portions, which are each within a dead angle to the 
driver to the vehicle 301 . as many as possible. The park- 
ing assist ECU 306 also receives a pulse signal corre- 



sponding to a steering angle detected by a steering an- 
gle sensor 311. and a back-lamp SW signal 312. which 
is output from the transmission and put in an on state 
when the vehfcle is backing. 

[0344] The parking assist ECU 306 responds to a vid- 
eo signal of the NTSC system from the camera unit 310, 
a pulse signal corresponding to a turn of a steering an- 
gle, which is output from the steering angle sensor 311 . 
and a back-lamp SW signal 31 2 of the back temp whfch 
is tumed on when the vehicle backs, and displays a pre- 
dfctive traveling path curve 305 of the vehicle 301 and 
a three-dimensional image generated along the predfc- 
five traveling path curve 305 on the screen of the infor- 
mal fc)n display devfce ^4, thereby making a parking as- 
sist. 

[034SJ Fig. 43 electrically sfiows the innards of the 
parkpig assist ECU 306 shown in Fig. 41. The parking 
assist ECU 306 contains a digital signal processor 
(DSP) 320 for carrying out an overall control and calcu- 
lations. Peripheral circuits are connected to the DSP 
320 by a bus 321. A video signal from the camera unit 

310 is input in the form of a composite vkJeo signal of 
the NTSC system to an amplifier/fitter circuit 322. The 
amplifier/filter circuit 322 selectively amplifies an anak>g 
video component contaried in the composite vfcleo sig- 
nal. The output signal of the amplifier/ritler circuit Is ap- 
plied to an anak^g to digital (ADC) 323 where its anak>g 
sigr^ fonm is converted into a digital form. The thus dig- 
itized vkieosigpial is then stored into a field buffer circuit 
324. The output signal of the amplifier/filter circuit 322 
is also applied to a sync separatfon circuit 325 which ri 
turn separates a horizontal sync signal and a vertical 
sync signal from the composite vWeo s\gria\. Those sync 
sicpais are input to the DSP 320. An angular displace- 
ment detect signal output from the steering angle sensor 

311 8md a center position detect signal generated when 
the center positton of the steering wheel 307 is detected 
are also input to the DSP 320. A back-lamp sigr^ is also 
applied to the DSP 320 by way of a buffer circuit 326. 
[0346] The DSP 320 operates in accordance with a 
program prestored in the program memory 327, whfch 
is connected thereto by the bus 321 . Data necessary for 
an operation based on the program ol the program 
memory 327 is stored In advance in a data memory ^8. 
The DSP 320 carries out a recognition process of the 
white lines 303 and the like ri response to the video sig- 
nal input thereto, and calculations for ^nerating a pre- 
dfctive traveling path curve 305 based on an angular dis- 
placement operatkDn of the steering wheel 307. 
[0347] The generated image is stored into field buffers 
331 and 332, either of which is selected according to an 
output signal erf an SW circuit 30. Either of the field buff- 
ers 331 and 332 is selected by the SW circuit 330, and 
an output signal of the SW circuit is output as an NTSC 
vkieo signal to the infomr^tion display devfce 304. by 
way of a digital to analog converter (DAC) 333 and a 
fitter/amplifier circuit 334. Electric power is supplied 
from a power supply 335 to the whole parking assist 



29 



57 



EP 1 065 642 A2 



58 



ECU 306. A reset circuit 336 supplies a reset signal to 
. the parking assist ECU 306 to reset the latter to an Initial 
state, and starts its operation according to the program, 
A CLK/frequency demultiplying circuit 337 supplies a 
clock signal defining a reference timing of the operation 
of the parking assist ECU 306, and signals formed by 
demultiplying a frequency of the clock signal. 
[0348] Fig. 44 isadiagram roughly showing a display 
of a parking assist image in the 13th emtxxliment of the 
inventbn. In the 13th enribodiment, guide lines 341 and 
342. and distance lines 341. 342 and 345 are displayed 
in the backward area image picked by the canr>era unit 
310 so as lo prcvfde an easy recognition of distance 
when an obstructive object, e.g.. a parking stopper, is 
present. The gukie lines 341 and 342 are rectilinear 
lines extending backward from both sides of the vehicle 
301 , and the distance lines 343 to 345 are lines for in- 
dk^ting distances from the rear end of the vehk:le. A 
wktth of a space between the guide lines 341 and 342 
corresponds to the width of the vehicle. Therefore, if 
those lines guide lines are parallel to the white V^es 303 
demarcating the parking space, all the driver has to do 
is to merely move t>ack the vehicle straight ty akxig the 
guide lines 341 and 342. Thus, the display of the Fig. 
44 image makes It easy for the driver to easily grasp a 
rough distance to the obstructive object 340 when nrtov- 
ing back the vehicle, and hence he easily sets the stop 
position. 

[0349] Rg. 45 is a diagram roughly showing a display 
of a parking assist image in the 14th embodiment of the 
inventton. In the 14th embodiment, a length of the pre- 
dictive traveling path curve 305 is adjusted in accord- 
ance with a distance ranging to the parking position. The 
parking position may be set at a position of an obstruc- 
tive object 340, such as a parking stopper Accordingly, 
a length of the predictive traveling path curve 305 that 
is overlaid on the fc>ackward area image of the vehicle 
301 is a distance from the rear end of the vehicle 301 to 
the obstructive object 340. Thus, the length of the pre- 
dfctive traveling path curve 305 nrray be adjusted in ac- 
cordance with a distance to the parking position. Ac- 
cordingly, an easy-to-understand display is presented 
to the driver 

[0350] Fig. 46 is a diagram roughly showing a display 
ot a parking assist image in the I5th embodiment of the 
tnventk>n. In the 15th emtxxiiment. it is assumed that 
three parking spaces 350, 351 and 352 are present side 
by side. The parking spaces 350 and 352, tocaled on 
both skies of the parkeng space 351. are already occu- 
pied by other vehteles 353 and 354. When the moving 
vehicle 301 backs to the empty parking space 351 k>- 
cated between those vehicles 353 and 354, a roof pre- 
dictive traveling path cun^e 355 is displayed to avoid col- 
liding of the vehble 301 with the roofs of the vehicles 
353 and 354. 

[0351] The vehicle 301 takes a three-danensional 
configuration. When the predictive traveling path curve 
305 corresponding to the bottom of the vehicle 301 is 



used, it is ditffcult to judge whether or not the roof portion 
of the self vehicle or the like will hit another vehicle 353 
or 354 or an obstructive object at a portion of the self 
vehk^le which is shaded by the adjacent vehble 353 and 

5 forms a dead space to the driver In this case, when the 
roof predk;tive traveling path curve 355 is used, the driv- 
er is successfully guided to the intended parking space 
in a state that the self vehk:le does not hit the roof of the 
other vehk^le 353 or 354. 

10 [0352] Fig. 47 is a diagram roughly showing a display 
of a parking assist image in the 16th embodiment of the 
invention. Also in the 16th emtxdiment, as in the Fig. 
46 embodiment. It is assumed that three parking spaces 
350 to 351 are present and of those parking spaces. 

IS two parking spaces 350 and 351 are already occupied 
by other cars 353 and 354. Projection Ihes 356 and 357 
of the vehicles 353 and 354 to the ground are displayed. 
By displayhg the projective lines 56 and 57 of the vehi- 
cles 350 and 351 parked ^ the parking spaces 350 and 

^ 351 located on both sides of the parking space 351 , the 
vehcle ^1 can accurately be moved into the parking 
space 351 irrespective of, in partrcutar, the side portion 
of the vehicle 353 parked on this side of the parking 
space 351 , which fonr^ a dead space to the driver 
[0353] Fig. 48 is a diagram roughly showing a display 
of a parking assist innage in the 17th embodiment of the 
invention. Also in the 17th embodiment, as in the Figs. 
46 and 47 embodiments, it is assumed that three park- 
ing spaces 350 to 351 are present, and of those parking 

^ spaces, two parking spaces 350 and 351 are already 
occupied by other cars 353 and 354. In the 1 7th embod- 
iment, a layout of c^her vehicles 353 and 354 parked 
skJe by side in the parking spaces on both skJes of the 
parkbig space 351 and a self vehble 301 , when viewed 

^ from the tc^. is nrKxjeled and displayed in the form of a 
plane model 380. The plane model 380 Is generated, by 
the OSP 320, on the t>asis of the rough configurations 
of the parking spaces 350 to 351 and the other vehicles 
353 and 354, positions of the vehfcle 301 relative to oth- 

40 er things, and a configuration of the vehicle 301 that is 
already input. With the display of the vehk>le 301 located 
retaVrve to other vehicles and the like as viewed from the 
top. the driver can easily grasp a position ot the self ve- 
hfcle relative to the parking space 351 and the other ve- 

^ hteles 353 and 354 parked in the parking space between 
the parking space 351 . and an orientation and advarx;- 
ing direction of the self vehkHe 301 . 
[0364] Also in the plane display shown in Rg. 48. a 
directon in which the self vehrcle 301 backs is oriented 

so downward on the screen of the informatk)n display de- 
vice 304. The plane display containing the thus oriented 
vehcle matches such a driver's feeling that he feels qui- 
et after parking his car in the parking space 351 . For the 
plane model 380, rf a parking zone is the reqularly or 

ss frequently used one, the shapes and the like of the park- 
ing spaces 350 to 351 may be input in the form of data 
in advance. 

[0355] F*^. 49 is a block diagram showing an electrical 
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arrangement of a parking assist ECU 366 used in the 
.18th embodiment of the invention. The parking assist 
ECU 366 resembles the parkingasstst ECU 306 shown 
in Rg. 43» Eind heru^e like or equivalent portions in the 
figure are designated by like reference numerals in Fig. 
43. for simplicity of explanatk>n. An angular displace- 
ment detect signal and a center position sigr^, and a 
shift lever position signal representing a gear position of 
the shift lever 308 and a signal derived from the select 
switch 367 are input to the DSP 320 by way of a buffer 
circuit 368. A timer 369 is also connected to the bus 321 . 
The timer 369 may be operated to count a ttrr^ set by 
the DSP 320. 

[0356] The select switch 367 is used for selecting a 
display of the plane model 380 as shown in Fig. 48 or a 
rKxmat display of the backward area image as shown in 
Fig. 46 or 47. A driver of the vehicle 301 can appropri- 
ately select one of those displays according to parking 
space conditions by operating the select switch 337. 
[03673 Rg. 50 shows a partdng assist procedural 
process in the Fig. 49 embodiment. The parkhg assist 
procedure starts at a step si . In a step s2, what executes 
the procedural process, or the DSP 320, checks if the 
shift lever 308 is shifted to the reverse gear position, by 
use of a shift lever position signal. If it is at the reverse 
gear position, the DSP 320 judges that a parking assist 
mode is set up, and executes a step s3. In this step, the 
DSP 320 checks if the select sviritch 367 is turned to a 
positkjn of the plane model 380. When it is turned to the 
plane nrxxiel position, a step s4 is executed to display a 
plane model 380. When the select switch 367 is not 
tumed to the plane model position In the step s3, a step 
s5 is executed to display a backward area image. 
[035S] After the step s4 or s5 ends in its execution, a 
step s6 is executed to check if the shift lever 308 is shift- 
ed to a drive gear positk>n. If it is not tumed to the drive 
positk>n. the DSP 320 consklers that the backward 
nxwement for parking continues, and returns to the step 
s3. Subsequently, a sequence the process executk)n 
from the step s3 to the step a6 is repeated. 
[0359] When the shift lever 308 is shifted to the drive 
gear position, the vehicle advances. In the present em- 
bodiment, the parking assist is continued for a fixed time 
so as to perform an effective parking assist also when 
alter nrtoving back the vehicle, the driver slightly mcfves 
it forward for a reverse turn of the steering wheel, and 
then moves back it for parking. To this end. in a step 57. 
the counting operation of the timer 369 is started, and 
the parking assist is continued till the counting operation 
by the timer 369 ends in a step s8. When the counting 
operation by the timer 369 ends in the step 88 or the 
shift lever 308 is not at the reverse gear position in the 
step s2, the procedural process ends in a step s9. A 
fixed time. e.g.. several tens seconds, is set in advance 
in the timer 369. When the shift lever 308 is shifted to 
the reverse gear posrtton before this set time elapses, 
the DSP 320 may be returned to the step s3. 
[036O] In each of the 1 3th to 1 8th embodiments men- 



tk>ned above, the DSP 320 is used for the cabulating 
process and control in the parking assist ECU 306 (366). 
If required, a general CPU may be used instead of the 
DSP. The DSPs or CPUs may be combined in use. For 

5 the image processing in the invention, a semiconductor 
integrated circuit designed to be used exclusively for the 
image prcx:6ssing may be used. 
[0361] Fig. 51 shows an external appearance of a ve- 
hk:le or vehicle 401 as an object which will undergo a 

10 series parking assist in 1 9th and 20th embodiments of 
the present rwention which will be described hereunder 
When the vehicle 401 moves on and along a traffic lane 
demarcated with white lines 403 on a road 402 and 
backs from the trafHc lane to the shoulder edge of the 

IS road and p£Lrks in a kx^atkin ck>se to arxi along the shoul- 
der edge of the road, image information for the series 
parking assistance is displayed on the screen of an in- 
formation display device 404. The image infomriatkjn 
contain a predictive traveling path curve 405 depicted 

20 on the calculation based on a predictton of a traveling 
path of the vehicle 401 , and others. The predictive 
traveling path curve 405 is calculated using a steering 
angle as an operatkxi angle of a steering wheel 407 for 
steering the vehicle 401. by a parking assist ECU 406 

2S as an electronic control unit (referred to as "ECU") for 
making a drive assist for the series parking. When a shift 
lever 408 of the transmission is shifted to the reverse 
gear position, for example, and a left winker lamp 409L 
of those right and left winker lamps 409L and 409R tights 

30 up, the display starts to assist a driver in parking the 
vehfele in a parking space along the left skle of the load. 
[0362] In nrK>ving the vehicle 401 backward for its 
paricrtg. a backward area of the vehicle 401 is the dead 
space when viewed from the driver, and he cannot suf- 

55 ficiently watch a backward area of the vehwle. To cope 
with this, a camera unit 410 is attached to the upper part 
of the body of the vehicle 401 , and pk:ks up a scene of 
the backward area defined by a field 410a The camera 
unit 410 produces a video sicpial of the NTSC type, for 

^ example, arxJ the parkrtg assist ECU 406 displays a 
predictive traveling path curve 405 overlaki on the tiack- 
ward area image on the screen of the display device 
404. 

[0363] Fig. 52 is a diagramnr^tic illustration showing 
^ a basic arrangement for a drive assist when the driver 
starts a series parking of the vehicle 401 of Fig. 51. A 
video signal input from the cannera unit 410 to the park- 
ing assist ECU 406 is of the NTSC type. A steering angle 
of the steering wheel 407 is detected by a steering sen- 
SOT 41 1 - The steering sensor 41 1 produces a pulse sig- 
nal every angular displacement of the steering wheel 
407 at a fixed angle, in the form of an angular displace- 
ment signal. When the shift lever 408 of thetransmisskwi 
of the vehicle 401 is operated to the reverse gear posi- 
55 tkwi, a back lamp SW signal 41 2 for turning on a switch 
(referred to as a SW) to light up a back lamp is produced 
and input to the parking assist ECU 406. A light -up sig- 
nal for the winder lamps 409L and 409R is also input to 
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the parking assist ECU 406. An image d a parking 
. space 4.13 is displayed on the screen of the display de- 
vice 404 . At this time, a shoulder edge of the road 402 
is also displayed. The parking space 41 3 is kx?ated be- 
tween, orexampte. vehicles 41 5 and 41 6 preceding and s 
subsequent to the self-vehicle. 
[0364] Rg. 53 schematically shows an eleclrfcal ar- 
rangement of the parking assist ECU 406 shown in Fig. 
51. An overall control in the parking assist ECU 406 is 
executed by a digital signal processor (DSP) 420. The io 
DSP 420 executes signal processing through a bus 421 . 
The camera unit 410 produces an NTSC video signal, 
and the video signal is amplified by an amplrfier/Tilter cir- 
cuit 422. The amplifier/filter circuit 422 extracts a video 
component signal from the video signal » and a signal is 
form of the vkieo component signal is converted from 
an analog form to a digital form by an analog to digital 
converter (referred to as an ADC) 423. The digitized vki- 
eo component signal is stored into a lieW buffer circuit 
424. The amplifief/filter circuit 422 also applies a video ^ 
signal to a sync separation circuit 425 where horizontal 
and vertical sync components are separated from the 
video signal. ArxJ those sync signals are input to the 
DSP 420. An angular displacement detect signal, which 
IS representative of an angular displacement of a steer- ^ 
ing angle, and a center position signal, which represents 
that the steering wheel 407 is at the center position, are 
input to the DSP 420 by way of a buffer circuit 426. A 
back lamp SW signal and a window lamp light-up sigr«l 
are also input to the DSP 420 via the buffer circuit 426. 30 
The DSP 420 operates an accordance with a program 
that is stored in advance in a program menrK»ry 427. 
whfch is connected via the bus 421 to the DSP 420 per 
se. The DSP 420 is capable of reading out data neces- 
sary for the prograrraned operation form a data memory ^ 
428, arxi writes data into the same. The DSP 420 rec- 
ognizes, in accordance with an hcoming vWe signal, the 
white lines 403 shown in Rg. 51, the shouWer edge of 
the road 402. and other parking vehicles. Further, it is 
also capable of calculating, on the basis of the recogni- -«> 
tion result, a target parking posttk>n of the vehble 401 , 
and an ideal traveling path or path curve along which 
the veh k;le nroves from the present position to the target 
parking position. 

[0365] The DSP 420 generates it so that it is overlaid 4S 
on the image derived from the camera unit 410, and 
stores them into fieki buffers 431 and 432 the outputs 
of which are selectively output through a SW circuit 430. 
The output signal of each of the field buffers 431 and 
432. which is selected by the SW circuit 430. is output so 
as a vkleo output signal to the display device 404, 
through a digital to analog (DAC) 433 and a filterMmpli- 
fier circuit 434. Electric power is fed from a power supply 
435 to the whole parking ass^t ECU 406. The parking 
assist ECU also receives a reset sigr>al from a reset cir- ss 
cutt 436. and a clock signal defining a base for the op- 
eratk^n timings and signals of demultiplied frequencies 
from a CLK/frequency demultiplytng circuit 437. 



[0366J Fig. 54 shows, in a simplified form, an image 
display presented on the screen of the information dis- 
play device 404, which the image display is carried out 
as the 19th embodiment of the present invent bn. A 
scene of the parking space 413 picked by the camera 
unit 41 0 is displayed on the screen of the display device 
404. Other vehicles 41 5 and 41 6 and the like are present 
before and after the parking space 413. A predictive 
traveling path curve 405. which is calculated depending 
on the present steering angle, is displayed extending 
from the rear end of the vehicle 401 to the parking space 
413. To property park the vehicle 401 in the parking 
space 413. the steering wheel 407 must be reversely 
turned during the backward movement. The parking as- 
sist ECU 406 as timing judging mear^s determines a ve- 
hicle positkxi suitable for the reverse turn of the steering 
wheel 407 on the predictive traveling path curve 405. 
and draws a guide line 440 of an oblique line at the suit- 
able position. The guide line 440 is drawn at a positkxi 
varying with the backward nrK>vement of the vehicle 401 
within an area within which the vehicle 401 may t>e 
parked at a target parking position 445 in the parking 
space 413 by operating the steering wheel 407. When 
the driver of the vehicle 401 reversely turns the steering 
wheel 407 at a position where the guide line 440 is co- 
incklent with the shouWer edge 41 4 of the road as a tar- 
get in the parking space 413. the parking will be com- 
pleted. When the predictive traveling path curve 405 will 
possibly come in contact with other vehicle or vehicles 
415 and 416. the driver stops the tiackwcird movement 
for the series parking, and advances the vehk^le 401. 
And if possible, the driver changes the directk>n of the 
vehicle 401 and tries to make the series pari<irtg. 
[0367] Fig. 55 shows a control procedure in the em- 
bodiment of Fig. 54. The control procedure starts in a 
step al. In a step a2. what executes the procedure, or 
the DSP 420 of the paricrig assist ECU 406, judges 
whether or not given series partying assist conditions 
hold. When the back lamp SW signal 412 is in an on 
state, and theleft winker lamp 409L or the right winker 
lamp 409R is turned on. the DSP judges that the series 
parking assist conditions hokJ. When the winker Isunps 
409L and 409R are both turned on for the hazard lamp, 
the DSP may judge that the vehkrfe will be series parked 
on and along the left side of the road as usual. If the 
series parking assist conditions hoW, the DSP judges 
which the skies of the road is used for the series parking 
in a step a3. In the next step a4, the DSP detects a target 
part<ing position 445 from the image picked up by the 
camera unit 410. In a step a5. the DSP detects a steer- 
ing angle of the steering wheel 407 of the vehfele 401 
by an angular displacement signal output from the steer- 
ing sensor 411 . In a step a6, the DSP cateulates a pre- 
dictive traveling path curve 405 depending on the steer- 
ing angle. In a step a7. the DSP judges whether or not 
the vehicle 401 may be moved from the present positton 
to the target parking posltkMi 445 by the steering oper- 
ation. When possible, the DSP judges a timing of turning 
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the steering wheel reversely in a step a8. After the re- 
. verse tum of the steering wheel, a (position of the guide 
trie 440 which is indicative of the reverse turn liming on 
the predictive traveling path curve 405 is determined 
and the resultant is added to the image. In a step a 10, 
the DSP judges whether or not the series parking assist 
conditions hold, as in the step a2. When the series park- 
ing assist conditions hold, the DSP returns to the step 
a5, and continues the parking assist in a similar manner. 
[0068] The judgement of the step a7 as to whether or 
rx>t the parking is allowed is made on the basis of the 
gathering of positkan data of the parking space 41 3 for 
the vehtele 401 at the start of parksig, comparison of it 
with the data of the gukle Irte 440 when the vehble 401 
is put In parallel, which is stored in advarrce, and a min- 
imum turn radius of the vehicle 401 , and the like. When 
the step a7 judges that the parking is impossible, the 
DSP displays a guide of"parking impossible" by the in- 
formation display device 404 in a step all. When the step 
a2 or alO judges that the series parking assist condi- 
tions do rx>t hokj, or that the step all displays the parking- 
impossible guide, the DSP ends its procedural process 
at a step a1 2. 

[0369] Fig. 56 shows an image for the series parking 
assist in 20th embodiment of the present invention. In 
the embodiment, like or equivalent porttons are desig- 
r^ated by like reference numerals in Fig. 54. A parking 
space 413 is tocaled between other vehicles 415 and 
41 6, andatarget partdngpositk)n 445 is detected. A pre- 
dictive traveling path cun^e 406 is displayed, which is 
predlctfvely generated on the basis of a steering angle 
of the present steering wheel 407. and an ideal traveling 
path curve 446 rangbg from the present vehicle position 
to the target parking positiofi 445 is displayed. Accord- 
ingly, the driver of the vehicle 401 can easily parte the 
vehk;le 401 in the target parking position 445 in a man- 
ner that he operates the steering wheel 407 so as to 
approxirrate the predictive traveling path curve 405 in 
shape to the kteal traveling path cun^e 446. 
[037O] Fig. 57 is a fk>w chart showing a control proce- 
dure by the DSP in the Fig. 56 embodiment. A proce- 
dural sequence from steps bl to b6 is equivalent to that 
from the steps al to a6 in the Fig. 55 ftow chart. A step 
b7 is executed to generate an ideal traveling path curve 
446 fornnoving the vehicle 401 from the present position 
of the vehk;le 401 to the target parking positkxi 445 de- 
tected in the step b4. The ideal traveling path curve 446 
is generated on the basis of position data of the target 
parking position 445 in the partcing space 413. which 
gatheredat the present position of the vehicle 401 at the 
start of the parking, and a minimum turn radius of the 
vehkjle. a speed of the backing vehicle, and the like. A 
step b8 is executed to check whether or not the gener- 
ation of the ideal traveling path cun^e 446 ends. When 
the generation ends, a step b9 is executed to generate 
a parking assist nmage in whk:h the predictive traveling 
path curve 405 cateulated In the step b6 and the kiea! 
traveling path curve 446 generated in the step b7 are 



overlaid on the backward area image output from the 
camera unit 410. and to display the parking assist image 
on the screen of the information display device 404. A 
step bio. like the step b2, is executed to judge whether 
5 or not the series partcing assist condition hokJs. When 
the conditkxi hokis, the control by the DSP returns to 
the stepb5. Subsequently, a procedural sequence of the 
steps b5 to bio is repeated. 

[0371] An kieal traveling path curve 446 based on a 
10 steering angle is displayed, if it is within a certain devi- 
atk>n it from the kJeal c»ie, without operating the steer- 
ing wheel 407 abng the kJeal traveling path curve 446, 
and the vehicle n^y be pariced at the target parking po- 
sitkxi 445. When the step bS judges that the generation 
IS of the ideal travellr>g path curve 446 does not end yet, 
a step bll is executed to display the guide of "parking 
imposs^^le". When the step b2 or blO judges that the 
series parking assist condition does not hold, or when 
the proems of the step bll ends, a step b12 is executed 
^ to end the partcing assist operatkxt. 

While in each of the above-mentk>ned embodiments, 
the camera unit 410 is used for taking a scene of the 
place behind the vehk>le for the series parking, the cam- 
era unit 410 may also be used for an out-of-lane moni- 
es toring purpose. In this case, the camera unit constantly 
recognizes the white lines 403 and checks vtrtiether the 
running vehkrfe is within or out of the traffrc lane. It the 
camera unit 410 is thus used for both the purpose of 
monitoring the place behind the vehble for the series 
^ parking assist and the purpose of monitoring the out-of- 
lane of the vehk:te. the required number of cameras in- 
stalled on the vehk^le Is reduced, leading to cost reduc- 
tkxi. 

[0372] In the vehk:le parking assist devk:e. an image 

3& of the area existing in the vehicle advancing direction is 
displayed, and a vehicle predictive traveling path pre- 
dk^ted on the basis of a steering angle of the steering 
wheel and gude lines prolonged from the lines defining 
the width of the vehicle body are overiaid on the Image 

^ of the area existing in the vehicle advancing directkxi, 
whereby the drive assist is pertormed. When the vehicle 
is backed for parking, the gukie lines prokxiged from the 
lines defining the width of the vehk^le body are overiaid 
on the image of the backward area. Therefore, the 

^ present direction of the vehicle is easily understood. 
Where white lines are drawn for the parking frame, the 
vehk;le may easily be parked in parallel to the parking 
frame in a manner that when the white tines are parallel 
to the guide lines, the steering wheel is returned to the 

so center posllton. 

[0373] Where displays of the predictive traveling path 
and/or gukie lines are selectively presented, the drive 
assist is performed in the display conditk>n best for the 
driving by the driver. 

55 [0374] In the vehtele paridng assist device, a bright- 
ness of a display of the predictive traveling path and^or 
gukie Irtes is varied In accordance with a brightness of 
the environment. The drive assist is performed in an 
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easy-to-see display condition. 

. [0376] . In the vehicle drive assist device, the drive as- 
sist means varies a color arrangement of a display of 
the predictive traveling path and/or guide lines in ac- 
cordarK^ with a color arrangement of the environment s 
A color arrangeriYent erf the display is changed to a color 
arrangement which is easy for the driver to understand 
in accordance with a brightness and a color arrange* 
ment of the environment, whereby an effective drive as- 
sist is carried out. io 
[0376] In the veh'cle drive assist device, the vehicle 
includes a brightness sensor for sensing a brightness of 
the environment to select an Illumination system, and 
the drive assist means varies a brightness or a color ar- 
rangement of a display of the predictive traveling path is 
and/or guide lines in accordance with a brightness 
sensed by the brightness sensor. 
Therefore, a display of the display means may be auto- 
matically changed to an easy-to-see display in accord- 
ance with a brightness and a color arrangement of the 20 
environment. 

[0377] In the invention, a color arrangement of a dis- 
play of the predictive traveling path and/ot guide lines 
is varied in accordarx:e with a baclcground color of an 
inr^ge picked up by the camera. With this feature, when ^ 
the background color is bright the predictive traveling 
path cun^e and the guide lines may be displayed using 
a dark color. When the background color is dark, the lat- 
ter displayed may be bright in cotor. Therefore, an easy- 
to-understand drive assist may be presented to the drrv- 30 
er. 

[037S] In the inventfc)n. the final display condition at 
the end of the parking assist is stored, and then the dfe- 
play condition is used for the next parking drive. 
Therefore, the drive assist nr^ay be performed in the dis- ^ 
play corxJitfon suitable for the parking gukie without set- 
ting anew, by the driver, anew the best display conditk>n 
every time the drive assist is performed. 
[0379] An image output from the camera of a wide an- 
gle fiokJ is distorted. In the invention, saki gukJe lines. 40 
when displayed, are curved in accordance vwth a distor- 
tion of the image. Therefore, the gukle lines exactly cor- 
respond to the lines respectively protonged from the 
l&nes defining the width of the vehicle body, whereby an 
effective drive assfet is fomied. 45 
[0380] The wkfth of the predctive traveling path curve 
and the gutie lines are not coincklent with the wkith of 
an actual vehicle body at its bumper and its near portion 
because of the field angle of the camera has a fieW an- 
gle. Therefore, in the Invention, the non-coincident por- so 
tion is not displayed, and the driving for this portton de- 
pends on the driver's judgement, whereby an unnatural 
display is eliminated. 

[0381] In the vehkHe drive assist device, the drive as- 
sist means displays the predtetive traveling path and/or ss 
guide lines such that the poitfons thereof near the vehi- 
cle are broadened. Therefore, the vehicle width is nat- 
urally contiguous to the predictive traveling path and the 



guide lines in the display. And a safety is secured. 
[0382] In the invention, a line indicative of a stop po- 
sftk>n of the vehicle is displayed at a position on the pre- 
dictive traveling path or the guide lines, which is bcated 
near the vehicle. Therefore, the line may be usefully uti- 
lized as such a mark that when the moving vehicle frame 
reaches the stop line, the vehtele is stopped. 
[0383] In the Invention, the guide lines are displayed 
when the driver operates the brake. In other words, 
when the braking operatkni is not performed, the gukie 
lines are not displayed, thereby eliminating a complexity 
of the drive assist image. Therefore, such a drive assist 
that when necessary, the guide lines are displayed by 
the braking operatkm arxt the steering wheel is retumed 
to the center positbn, is effectively performed. 
[0384] In the inventkxi, the guide lanes are displayed 
by dotted lines, and hence are made unrK>ticeable. 
Therefore, the predk^tive traveling path is easy lo see, 
and the drive assist is performed in an easy-to-under- 
stand fashk^n. 

[0385] In the inventkxi, a length of the guide lines is 
varied in accordance with a distance ranging to an ob- 
6trt»cttve object detected by the obstacle sensor, such 
as a back sonar. Therefore, the length of the gukle Kne 
corresponds to the remaining driving distance. A drive 
feeling resembles an actual driving feeling, and a driver 
assist whrch is easy for the driver to understand is pro* 
vkied. 

[0386] In the Invention, the width of the guk)e lines, 
when disp^yed, is wider than the wkith of the vehicle. 
Therefore, such a drive assist that when the gukJe line 
lies on one side of the parking frame, the driver returns 
the steering wheel to the center position is readily per- 
fonmed if the wkfth of the guide lines is wfcter than that 
of the actual vehicle wkJth. 

[0387] In the vehicle parking assist devk^. an image 
of a backward area of the vehk^te is picked up. and an 
effective drive assist is performed. When the transmis- 
sion is set to the reverse gear mode, a display by the 
display means changes to inform the driver of the trans- 
misskxi be'\ng in a reverse gear mode. The display 
change infomns the driver that thetransmtsskxi is shifted 
to a reverse gear position, and the vehicle will back, in 
an easy-to-understand manner Accordingly, the driver 
never makes a mistake of the fact that the advancing 
directk>n of the vehicle is a txackward movement. 
[0388] In the invention, when an obstructive object is 
detected by the obstacle sensor such as a back sortar 
or comer sensors, a display by the display means which 
displays a backward area innage of the vehicle is 
changed to intorm the driver of the presence of the ob- 
structive object in an easy-to-understand manner, there- 
by preventing the vehicle from touching the obstructive 
object. 

[0389] In the invention, the drive assist information is 
displayed in the fomn of character telop. Therefore, the 
driver is reliably inforn^ of the contents of the display. 
[0390] In the vehble drive assist devk:e, the drive as- 
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sisl means displays information of tlie reversa gear po- 
• sition artd obstacle ctetection in the form of a color 
change of the entire display. The color change of the 
entire display reliably calls a driver's attention. 
[0391] In the vehicte parking assist devices, a telop s 
for urging the driver to make a salety check by the eye 
are displayed on the display for assisting the drive assist 
by use of an image picked up by the camera. Therefore, 
driver's attention is attracted to the front and side areas 
of the vehicle, which are not displayed on the display io 
screen. 

[0392] When the vehk^e backs for parking, the vehble 
parking assist device infonns the driver of the end of the 
parking operatkjn while being riterconnected in opera- 
tion with an obstacle sensor, such as a back scxiar. 
Therefore, the driver can readily check the detection re- 
sult of the obstacle sensor by the display means. 
[0393] In the inventkwi, when the vehicle is moving 
backward, a speed of the vehk:le is Ivnited to the preset 
upper limit of the vehfcle speed or tower. Therefore, col- 20 
lision of the vehicle when it is moved backward is pre- 
vented or shock when the colliskxi occurs is lessened. 
[0394] In the invention, when the obstacle sensor de- 
tects an obstacle such as a back soar, the drive assist 
means limits a speed of the vehtele to the preset upper 2^ 
limit of the vehk^le speed or lower. Therefore, collision 
of the vehicle when it is moved backward is prevented 
or shock when the collision occurs is lessened. 
[0395] When the vehcte is moving backward, the 
drive assist mearts changes an illumination direction of 3o 
a lanp illuminating a backward area of the vehicle, 
thereby effecting the drive assist. Therefore, when the 
parking tot is dark at night, the image picked up by the 
camera is increased in brightness, thereby ricreasing 
the visibility. 05 
[0396] I n the invention, the lamp is optionally attached 
to the device. Therefore, an appropriate illumination Is 
performed in accordance with a coverage by the cam- 
era. 

[0397] In tfie vehcle drive assist devk^, the vehicle 40 
is equpped with a car-carried device including a navi- 
gation device and/or audto device, and further it com- 
prises select nrteans for causing the display nrteans to 
selectivety display the in^ge from the camera arxf the 
Inr^ge from the drive assist means or the image from 4S 
the car-carried devk;e. Therefore, the driver selects the 
drive assist or the utilization of the car-carried device in 
accordance with his necessity. 
[0398] In the vehicle parking assist devices, a scene 
of the area in the advancing directton of the vehicte is ^ 
picked up by the camera. arKi a drive assist useful for 
the parking drive is perfonned. Particularly, a nonnal 
p£irking nrwde or a series parking nrKxJe may be select- 
ed. Therefore, the drive assist suitable lor the parking 
mode may be effectively performed. ss 
[0399] The paricing mode is automattoally changed to 
a series parking mode when the turning on of a winker 
lamp or a hazard lamp and the shifting of the transmis- 



sion to the reverse gear mode are simultaneously per- 
formed. A proper drive assist is perfomned without a 
manual operatton by the driver to change the parking 
mode change. 

[0400] In the invent ton. the drive assist means judges 
whether a parking position in which the vehicle is to be 
parked is in a parking tot or on a road, on the basis of 
the present position of the vehicle derived from the nav- 
igation device. When the parking position is in the park- 
ing tot. the normal parking mode is automattoalty select- 
ed, and when the parking positbn is on the road, the 
series parking mode is automatically selected, whereby 
a proper drive assist is performed. 
[0401] Since the normal parking mode or the series 
parking mode is selected depending on a change of 
steering angle of the steering wheel for steering the ve- 
htole. the parking mode may be automat bally changed 
to the series parking mode by a special steering opera- 
tion, such as the reverse turn of the steering wheel. 
whkMi is used for the series parking. 
[0402] In th e invention, em effective drive assist is ca r- 
ried out by use of images output from a plurality of cam- 
eras are disposed such that the photographing areas 
covered by the cameras Eire shifted so as to pick up a 
scene around the vehicle. A display screen of the dis- 
play nrteans is segmented into plurality of segmental dis- 
play areas in accordance with the arrangement of the 
cameras. The images by the pluralit/ of cameras are 
simultaneously displayed on those segmental display 
areas. Therefore, the driver may look a plurality of im- 
ages on the same screen of the display means, whereby 
an effective drive assist is performed. 
[0403] In the invention, a display on the screen is 
changed in accordance with a drive conditton. Accord- 
ingly, a display of visual informal ton which is easily un- 
derstood by the driver may be presented through an au- 
tomatk: changing of a screen segmentation such that in 
the normal running, two images of the front left and front 
right areas of the vehtole are d^played. and in the back- 
ward mnning. three images of the front left and front right 
areas, and the backward area are displayed. 
[0404] Also in the inventkxi, a vehicle is displayed in 
a simplified fonm on a display of the images coming from 
the plurality of cameras. Therefore, a relationship of the 
vehtole relative to the images from the plurality of cam- 
eras is displayed in an easy-to-understand fashion. 
[0405] In the vehtole drive assist device, a display po- 
sitton of the simplified displayed vehtole is moved ac- 
cording to an image from the camera. Therefore, the 
driver easily recognizes which camera picked up the 
age being displayed from the display. 
[0406] When the vehtole is displayed in a simplified 
form, the directior^ and photographing areas covered 
by the cameras are also displayed. Therefore, the driver 
easily recognizes which camera ptoked up the image 
being displayed from the display. 
[0407] In the vehicle drive assist device, the images 
from the plurality of cameras arKJ an image from the car- 
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carried cievice. such as a navigation device and/br audio 
.device, are displayed on the segmental display areas, 
[0408] Therefore, the driver may look both the innage 
by each camera and the image by the navigation device 
or the audio device on the same display screen. s 
[0409] In the invention, the images by the plurality of 
cameras are changed one to another at predetermined 
time intervals, to thereby eliminate the manual work of 
the driver to change the images. 

[0410] In the inventbn, the wipe is used for gradually io 
changing the images from the plurality of cameras one 
to another Therefore, there is no chance that the image 
is abruptly changed from one image to another 
[0411] In the vehcio drive assist device, a scene of a 
side area of the vehicle is displayed white being inter- '5 
connected with an operatksn of the directkxi indicator 
Therefore, an image taken in the vehicle advanchg di- 
rectkxi is automatk^ally displayed, whereby the vehicle 
parking assist device effectively assists the driver to 
nr^e a safety check. 20 
[0412] In the invention, the images are charged one 
to another in accordance with a steering angle of turn of 
a steering wheef. Therefore, the image of the area ex- 
isting in an actual vehicle advancing direction is auto- 
rmticatly displayed, and the device assists the driver 25 
safely and effectivefy. 

[0413] In the invention, the screen segmenting corxJi- 
tion is changed in accordance with a steering angle of 
the steering wheel. Therefore, the image of the area k>- 
cated in the advanchg directk>n is displayed on a wide ^ 
display screen. 

[0414] In the inventfon, when an obstructive object is 
detected by the obstacle sensor, e.g.. a comer sensor, 
an obstacle sensing direction is displayed. The vehicle 
parking assist device calls driver's attention to the pres- ^ 
ence of the obstacle. 

[0415] An image located in the obstacle sensing di- 
rection is displayed, it nrtay be checked on the screen. 
[0416] In the vehicle drive assist device, when an ob- 
stacle ts detected, the drive assist means causes the ^ 
display means to shift a display positron of an image out- 
put from the camera which picks up the sensing direc- 
tion of the obstacle sensor, to the center of the screen 
ot the display means or to expand the display. 
[0417] Therefore, the resultant display reliably at- 
tracts the driver's attention to the presence of the ob- 
structive object and its state. 

[0418] In the ffivention. an alarm is overiaid on a dis- 
play of the sensrig direction of the obstacle sensor 
Therefore, the alarm reliably turns the driver's one's at- so 
tention to the obstructive object. 
[0419] In the vehicle drive assist devbe. when the im- 
ages of the cameras adjacently disposed are simulta- 
neously displayed, those anages are continuousfy con- 
nected together into a single inrage. With the composed 55 
image, the image covering an expanse of area, whrch 
is easy for the driver to understand, is provided to the 
driver, to thereby effect an effective drive assist. 



[0420] tn the vehicle drive assist device, the camera 
are disposed so as to take he scenes of the front, front 
left, front right, back left and back right areas of the ve- 
hicle. Therefore, the driver can make a safety check on 
the entire circumferential area around the vehble. 
[0421] Further, the image of the entire circumferential 
area around the vehicle may effectively be used in ac- 
cordance with an arrangement of the cameras. 
[0422] Additionally, a necessary image is selected 
from those output from the cameras disposed around 
the vehicle, and is displayed in detail. 
[0423] The rnrtages output from the cameras having 
the photographing areas successively disposed are 
scrolled into a single rnage. Therefore, the driver is able 
to readily check the irrtage of a broad area around the 
vehk^fe in a natural fa5hk>n. 

[0424] The driver can change a disp^y conditk>n of a 
desired image in simple and quick manner by use of the 
touch panel. 

[0425] Further, the driver causes the display means 
to display a desired image for an elongated time in sim- 
ple and quick manner 

[0426] In the vehicle parking assist device, an effec- 
tive drive assist is performed by use of a camera for pick- 
ing up a frontward scene of the vehicle. An image of the 
frontward scene Is stored into the storrig means, there- 
by acquiring information for the drive assist According- 
ly, the image by the camera may also be used as traffk; 
congestk>n information, whereby it may be effectivefy 
used for grasping traffk; conditions arourxi the vehicle. 
[0427] Since the frontward image picked up by the 
canrtera Is displayed by the display means, it nrtay be 
used for checking the frontward scene. Therefore, use 
of the sirrgle camera reduces the cost when comparing 
with a case where cameras are respectively provided 
for picking up the frontward and backward scenes. 
[0428] In the invention, a vehicle forcibly running into 
a place in front of a self vehicle is detected by processing 
the image coming from said camera. Therefore, the 
camera may bo used for detecting such a vehk:le. and 
even if such a vehk;le appears, the driver drives the ve- 
hk^le in safe. 

[0429] In the vehicle parking assist device, a camera 
is attached to the top of a vehicle and picks up a scene 
around a vehicle as viewed from the top of the vehicle. 
Display means disp^ys the image picked up by the 
camera. A limit of a vehicle height is detected from the 
innage picked up by the camera. Therefore, the driver 
can readily check whether or not the vehicle may pass 
under an elevated bridge, for example. 
[0430] In the vehicle parking assist devfce, n accord- 
ance with the moving direction of the vehk;le. in nat>ack- 
ward running, the display means disp^ys nr>ore brightly 
an inriage of the backward area than an image of the 
forward area. Therefore, the driver can watch the back- 
ward area in detail when backing the vehble. 
[0431] In the vehicle parking assist device, an image 
of the backward area from the camera is displayed re- 
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fleeting an Image on the back mirror. Accordingiy, the 
* image of the backward area is dispteyed in a display 
mode familiar to the driver. The drive assist is effectively 
carried out. 

[0432] In the vehicle drive assist device, the drive as- 
sist means modifies a backward area Image displayed 
in the display frame tor the back mirrors into an image 
having a fiekJ angle equal to that of the back mirror. 
[0433] Therefore, the driver kx>ks the backward area 
image as if he kx>ks the back mirror, wheret>y an effec- 
tive drive assist is performed. 

[04341 When a parking assist is carried out in a state 
that a predictive traveling pathcurve» which is calculated 
depending on a steering angle is overtald on a display 
of the imago which is picked up in the vehicle advancing 
directk>n. and a 3-three dimensional image containing 
the vehk;le height is additior^ally displayed akxig the pre- 
dictive travefing path curve, a display of the 3-dimen- 
sional image is changed at a positkxi near an obstruc- 
tive object detected by the obstacle sensor, from that at 
other positions. Therefore, it is easy to check a possibil- 
ity that the vehicle will touch an obstructive object near 
the traveling path of the vehrcle, and a touching position 
when it touches the obstructive object Accordingly, the 
vehicle drive assist device can assist the driver In his 
driving operation such that the touching of his car with 
the obstructive object is avoided ar>d the driving opera- 
tion is easy. 

[043S] In the invention, the drive assist means dis- 
plays the 3-dimensional information trriage in the fomn 
of planes each having a predetermined shape which are 
arrayed at fixed distances along the predtetive traveling 
path curve. Therefore, the driver readily checks from the 
displayed image a space occupied by the vehicle when 
it advances and a ^dimensional touch possibility of the 
vehicle with an obstructive object existing along the 
traveling path. 

[0436] In the invention, the 3-dimensk>na( in^ge con- 
taining the vehfcle height moves as a plane of a prede- 
termined shape, which represents a height of the vehi- 
cle, along the predictive traveling path cun^e. Therefore, 
the driver readily may check a possbility that the vehicle 
will touch an obstructive object tocated near the predic- 
tive travelog path curve and a touching position when 
it touches the object. 

[0437] In the invention, a plane of a predetomnined 
shape, which represents a height of the vehicle, is 
moved along the predictive traveling path curve, and is 
stopped at a positkxi close to the obstnictive object. 
Therefore, the driver 3-dimensionaIly may check in de- 
tail a possibility of touching of the vehicle with the ob- 
structive object. 

[0433] In the inventbn, the drive assist changes a 
color of the S-dimensional information image at a posi- 
tion which is close to a positk>n where the obstructive 
object is detected. Therefore, the driver readily may 
check, from a change of the color, a possibility that the 
vehicle will touch an obstructive object located near the 



predictive traveling path curve and a touching position 
when it touches the object. 

[0439] In the inventk>n. a display is presented such 
that a simulation innage of the self vehicle moves in the 

5 image picked up by the carr^era. Therefore, the driver 
checks a possibility touching of the vehicle with an ob- 
structive object in a simulatk>n manner. 
[0440] In parkrig the vehicle, a target parking position 
is detected, a steering angle necessary for the advanc- 

10 ing of the car to the target parking position is calculated, 
a drive assist for parking is carried out with such a gukie 
that a steering angle is approximate to the calculated 
one. Since the driver is supported so as to be able to 
more safely drive the vehicle, the driver can easily park 

IS the vehicle into a narrow parking space or a congested 
parkng bt. 

[0441] When the vehicle, which advances for its park- 
ing, cannot advance to a target parking position by a 
steering operation withri a range of steering cingles 

20 within which the steering wheel may be turned, or when 
it is judged that the vehicle will touch an obstructive ob- 
ject during its advar^cing, the driver is given an Instruc- 
tkxi to reverse an advsinctng direction of the vehicle. Ac- 
cordingly, the drive assist can inform the driver of the 

2S partmg being possble. and the necessity and timing of 
the reverse turn of the steering wheel. It never happens 
that the driver tries to advance the vehicle to a parking 
space which rejects its parking, and causes a trouble of 
touching of his vehicle with ar>other vehicle. In this re- 

00 spect. the driver can safely drive the vehicle. 

[0442] In a case that a parkHg stopper exists in the 
parkhg space, it is auton^tk^lly detected and the driver 
is informed of the presence of the parking stopper. 
Therefore, the driver may drive the vehicle for parking 

55 while referring to the stopper. 

[0443] A vobe guWe makes it for the driver to park the 
vehicle. In this case, the drive assist is easy to under- 
stand since the visual sensation of the driver is rtot di- 
rectly utilized. 

40 [0444] The drive assist of the invention gives the driv- 
er warning of watch Big vehicle environments, e.g.. the 
front and side of the vehicle, when he parks the vehicle. 
TTierefore, safe drive is ensured by turning his attention 
to the vehble environmental conditions. 

45 [0445] The drive assist for parking of the inventton dis- 
plays a parking gukJe image overiaid on the image of an 
area existing in the etdvancing directk>n. which is prcked 
up by the camera. This parking guide display is easy to 
understand. 

so [0446] In the present inventkjn, the guide lines pro- 
kMiged from the lines defining the width of the vehtele 
and distance lines are overlaid on the backward area 
image, thereby provkJing a parking assist which is easy 
for the drh/er to understand. 

55 [0447] The predictive traveling path cun^e 305 over- 
laid on the backward area innage is adjusted in accord- 
ance with a distance to a stop position. Therefore, a path 
along which the vehicle runs till it parks is displayed in 
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the backward area nmage such that the driver easily un- 
. derstands the path. Accordingly, the vehicle parking as- 
sist device of the invention approp riately assists the driv- 
er in his parking. 

[0446] I n the invention, a roof predictive traveli ng path s 
curve of the self vehicle is displayed overlaid on the 
backward area image. Even if a portton of the self vehi- 
cle which will be a dead space to the driver because of 
the presence of another vehicle adjacent to the self ve- 
hicle, is present in the backward area image, the driver 10 
adjusts the predictive traveling path curve so as to avoid 
colliding of the self vehwie with the roof of the vehicle, 
and nrtoves back the vehtele for parking, whereby an ef- 
fective parking assist is perfornned. 

[0449] Even if the predictive traveling path cun^e of is 
the self vehicle is shaded by EirK>ther vehtele parked in 
a parking space adjacent to a parking space in which 
the self vehicle is to be parked in the backward area im- 
age, a projective line of the other vehicle to the ground 
is disptayed. and the vehicle parking assist device as- so 
sisls the driver in his parking by use of the predictive 
traveling path curve and the projective line to the 
ground. Therefore, even vrt an area forming a dead 
space in the image, it is possible to reliably check a po- 
sitional relationship of the predictive traveling path cu we 
of the self vehicle ranging to the parking space to other 
vehicles. 

[045O] The vehble parking assist devce of the inven- 
tion displays a layout of the self vehicle and other vehi- 
cles in tho parking areas when viewed from the top by 30 
use of a plane nrxxiel. Therefore, the driver can easily 
grasp a positkxial relatbnship of the self vehicle, a park- 
ing space, and other vehicles parked in other parking 
spaces, and an ortentaton artd moving direction of the 
self vehicle. 3S 
[0451] In the vehicle parking assist devk;e. a parking 
guide by the plane nnodel or a parking guide by the back- 
ward area image is selected in use. For example, a park- 
ing assist may appropriately be selected according to 
parking space conditions and the like. 40 
[0452] Further, in the vehicle parking assist device of 
the invention, after the movement of the vehicle is 
switched from a backward movement to a fonward 
nfKjvement. the displaying of a parking assist image of 
the backward area is continued for a fixed time. There- ^ 
fore, the driver can easily check the backward area of 
the vehule for advarx^ingthe vehicle or reversely turning 
the steering wheel. 

[0463] The present invention enables the driver to 
easily make a series parking when he moves back the so 
vehicle and parks it h a space between other two adja- 
cent vehicles parked in row since in such a situation, a 
predictive traveling path cun^e based on an steering an- 
gle is overlaki on an irr^ge of a place behind his vehicle 
on the screen of an information display device, and the 55 
dispby is added with guide information for a steering 
operation that is performed at the timing of the steering 
wheel reverse turn for the series parking. 



74 

[04S4] In the inventk>n. the timing of the steering 
wheel reverse tum is deputed in the form of a predtetive 
traveling path curve. Accordingly, the driver can easily 
make^a series parkhng by operating the steering wheel 
according to a relationship between an oblique line and 
a parking target. 

[0455] In the invention, the series parking assist au- 
tomatically commences by merely performing an oper- 
atkxi necessary for the driving operatran. Therefore, 
there is eliminated cumbersome switch operatbns 
whk;h othenwise would be unavoidable in the series 
parkBig. 

[0456] In the invention, judgement Is made as to 
whether a place for the series parking is on the right skJe 
or the left skJe of the vehk^le on the basis of the combi- 
natran of lighting conditiorw of the hazard lamp ancVbr 
the winker lamp. Therefore, the series parking assist is 
automatically performed for a proper skie of the road. 
[0457] In the present inventk>n, the image by the cam- 
era msey also be used for the laneoff monitoring. There- 
fore, there is no need of providing cameras respectively 
for the series parking monitoring and the tane-off mon- 
itoring. A single camera may be used for both the pur- 
poses, resutttng cost reductk>n. 
[0456] In the invention, whether or not the series park- 
ing is possible is judged before the parking operation 
starts. If the series parking is impossible, the driver 
changes the direction of the vehicle traveling path, aruJ 
win find another parking space. 



Claims 

1. A vehcle drive assist system compris'ng: 

a camera for pk:king up an image of an area 
existing in an advancing directk>n of a vehicle; 
display means for displaying the rnage picked 
up by the camera; 

steering angle detecting means for detecting a 
steering angle for steering the vehksle; 
traveling path predicting means for predicting a 
traveling path of the vehicle on the basis of the 
steering angle detected by the steering angle 
detecting means; and 

drive assist means for overtaying on the display 
means drive assist tnfonmatkxi containing the 
vehcle predictive traveling path predicted by 
the traveling path predicting means and guide 
lines prolonged from the lines defining the wWlh 
of the vehicle body on the image <rf the area 
existing in the vehk^e advancing directkxi. 

2. The vehk^le drive assist devk;e according to claim 
1 , wherein the drive assist means selects a display 
of the predictive traveling path and/or gube Ihes. 

3. The vehicle drive assist device according to claim 
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2, wherein, the drive assist means varies a bright- 
ness of the display of the predictive traveling path 
and/or guide lines in accordance with a brightness 
of the environment. 

5 

4. The vehicle drive assist device according to claoT) 
2. wherein the drive assist means varies a cotor ar- 
rangement of a display of the predictive traveling 
path and/or guide lines in accordance with a color 
arrangement of the environment. io 

5. The vehicle drive assist device according to claim 
2» wherein the vehicle Includes a brightness sensor 
for sensing a brightness of the environment to se- 
lect an illumination system, and the drive assist »5 
means varies a brightness or a color arretngement 

of a display of the predictive traveling p>ath and/or 
guide lines in accordance with a brightness sensed 
by the brightness sensor 

20 

6. The vehicle drive assist device accordoig to ctaom 
2, wherein the drive assist means varies a cotor ar- 
rangement of a display of the predictive traveling 
path and^or guide lines in accordance with a back- 
ground color of an image picked up by the camera. 2S 

7. The vehicle drive assist device according to any 
Of claims 2 to 6, wherein the drive assist means 
comprising: 

parking drive Judging means for judgrig wheth- 
er or not the drive of the vehtele is a parking 
drive; 

parking end judging means for judging whether 
or not the parking drive ends, when the parking ss 
drive judging means judges that the vehicle 
drive is the paricing drive; 
storing means for storing a select condition for 
displaying the predictive traveling path and/or 
guide lines, when the parking erKJ judging 40 
means judges that the peirking drive ends; and 
select means, when the parking drive judging 
means judges that the vehicle drive Is a parking 
drive, for selecting a display condrton of the 
drive assist informatkxi in accordance with the ^ 
contents of the storing means. 

8- The vehicle drive assist devbe according to any 
of claims 1 to 7. wherein the camera picks up an 
inrtage by a wide angle field, and the drive assist so 
means displays the gukJe lines curved in accord- 
ance with a distortion of the wide angle image 
picked up by the camera. 

9. The vehicle drive assist device according to any 
of claims 1 to 8. wherein the drive assist means dis- 
plays the predk^tive traveling path and/or guide lines 
except the portions thereof near the vehicle. 



10. The vehfcle drive assist devtee according to any 
of claims 1 to 8, wherein the drive assist means dis- 
plays the predwtive traveling path and/or gukle lines 
such that the portk)ns thereof near the vehicle are 
broadened. 

It. The vehicle drive assist device according to any 
of cbinr^ 1 to 10. wherein the drive assist means 
displays a line indicative of a stop position of the 
vehicle at a posrtkxi on the predk:!tive traveling path 
Eind/or guide lines, where the line Is located near 
the vehicle. 

12. The vehfcle drive assist devk;e according to any 
of clairris 1 to 11, wherein the drive assist means 
displays the gukJe lines when braking is effected. 

13. The vehk:le drive assist devtoe according to any 
of claims 1 to 12. wherein the drive assist means 
displays the gukle lines in the form of cfc)tted lines. 

14. The vehk:le drive assist devk;e according to any 
of claims 1 to 13, further comprising: 

an obstacle sensor for detecting presence or 
absence of an obstructive object on a vehicle 
traveling path. 

wherein the drive assist varies a length of the 
gukle lines in accordance with a distance ranging 
to an obstructive object detected by the obstacle 
sensor. 

16. The vehfcle drive assist devtee according to any 
of ctainr^ 1 to 14. wherein the drive assist means 
displays the guide lines in a state that the width of 
the gukJe lines is wider than the width of the vehrcle. 

16. A vehfcle drive assist system conrprising; 

a camera for pk^ng up an image of an area 
existing in the advancing direction of a vehicle; 
display means for displaying the image picked 
up by the camera; 

reverse gear mode detecting means for detect- 
ing as to whether or not a transmission of the 
vehk^le is set to a reverse gear mode; and 
drive assist means, when the reverse gear 
mode detecting means judges that the trans - 
misskxi is set to the reverse gear nrxxie. for 
chang'ng a display by the disptey means emd 
Infomning a driver that the transmissk>n is In a 
reverse gear mode, thereby effecting the drive 
assist. 

17. A vehkjie drive assist system conrprising; 

a camera for pk:king up an image of an area 
existing in an advancing d(rectk>n of a vehcle; 
display means for displaying the rnage picked 
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up by the camera; 

•an obstacle sensor for detecting presence or 
absence of an obstructive object in a backward 
area of the vehicle; 

drive assist means, when an obstructive object s 
is detected by the obstacle sensor, informing a 
driver of presence of an obstructive object by 
changing a display by the display means. 

18. The vehicio drive assist device according to 
claim 16 or 17, wherein the drive assist means dis- 
plays information in the form of character tolop for 
the drive assist. 

19. The vehicle drive assist devbe according to is 
claim 16 or 17, wherein the drive assist nr>eans dis- 
plays information in the form of a color change of 
the entire dtsp^. 

20. A vehicle drive assist system comprising; ^ 

a camera for picking up an image of an area 
existing in an advancing direction of a vehicle; 
display means for displaying the imago picked 
up by the camera; 25 
drive assist means for detecting a drive corKti- 
\\on anti judging whether or not the drive mode 
is a parking drive mode, the drive assist means, 
when the drive mode is a parking drive mode, 
for causing the display means to display the im- 30 
age picked up by the camera and an image for 
parking drive assist; and 
safety check means for displaying on the image 
for the parking drive assist a telop to urge a driv- 
er to make a safety check. 55 

22. A vehicle parkong assist device comprising: 

a camera for picking up an image of a backward 
area of a vehk:le; 40 
display means for displaying the image picked 
up by the camera; 

obstacle sensor for detecting presence or ab- 
sence of an obstacle in the backward area of 
thevehfcle; 45 
drive assist means for detecting a drive condi- 
tion and checking if the vehbte backs for park- 
ing, the drive assist mearis. when the vehicle 
backs, for displaying drive assist inf ormatwn for 
parking; and so 
safety check means for checking the parking 
drive ends on the basis of the result of the ob- 
stacle detectkxi by the obstacle sensor, and 
when the parking drive ends, the safety check 
means for causing the display means to display ss 
the end of the parking drive. 

22. A vehicle parking assist device comprising: 



a camera tor picking up an image of a backward 
area of a vehicle; 

display means for displaying the 'mage picked 
up by the camera; 

reverse gear mode detecting means for judging 
whether transmissbn of the vehicle is set to a 
reverse gear mode; and 
drive assist means, when the reverse gear 
mode detecting means judges that the trans - 
misskxi is set to the reverse gear mode» for lim- 
iting a speed of the vehicle to a preset upper 
limit value or lower, thereby effecting the drive 
assist. 

23. A vehicle parking assist device comprising: 

a camera for pk^king up an image of a backward 
area of a vehk:le; 

display means for displaying the rnage picked 
up by the camera; 

obstacle sensor for sensing presence or ab- 
sence of an obstacle in a backward area of the 
vehk^te; and 

drive assist means, when the obstacle sensor 
detects the obstacle, for limiting a speed of the 
vehk;le to a preset upper limit value or lower, 
thereby effecting the drive assist. 

24. The vehicle parking assist device comprising: 

a camera for picking up an Image of a backward 
area of a vehk:le; 

display means for displaying the image picked 
up by the camera; 

reverse gear mode detecting means for judging 
transmisskxi of the vehicle is set to a reverse 
gear mode; and 

drive assist means, when the reverse gear 
mode detecting mear>s Judges that the trans- 
misskxi is set to the reverse gear mode, for 
changing an ilium ration directkin of a lamp il- 
luminating the backward area of the vehicle, 
thereby effecting the drive assist. 

25. The vehk^le drive assist device according to 
claim 24, wherein the tamp is optkxialfy installed. 

26. The vehk^le drive assist devk^ according to any 
ot darns 1 to 25, the vehble drive assist device 
mounted in the vehicle having a car-carried device 
Including a navigation devk^e and/or audb devk^, 
the vehicle drive asset device further comprising: 

select means for causing the display means 
to selectivety display the image from the camera 
and the image from the drive assist means or an 
rnage from the car-carried device. 

27. A vehicle parking assist device comprising: 
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a camera for picking up an innage of an area 
•existing in a velticte: 

display means for displaying the image picked 
up by tlie camera; arxi 

drive assist means for switching drive assist in - 5 
formation for parking overlaid on the image dis- 
played by the display means between the drive 
assist information of a normal parking mo6e 
and that of a series parking mode. 

JO 

28. The vshk:le drive assist devbe according to 
claim 27, wherein the drive assist means selects the 
drive assist informatkm of a series parking mode 
when the turning on of a vmker lamp or a hazard 
lamp and the shifting of the transmission to the re- is 
versa gear mode are simultaneously performed. 

29. The vehicle drive assist device according to 
claim 27 or 28, the vehble drive assist device 
mounted bn the vehicle having a navigatk>n device. 20 

wherein the drive assist means for judging 
whether a parking positk>n in which the vehicle is to 
be parked is in a parking lot or on a road on the 
basis of the present position of the vehicle derived 
from the navigation device, and the drive assist 
means for selectrig the drive assist informatk>n of 
the normal parking mode when the parking positk)n 
is in the parking lot. the drive assist means for se- 
lecting the drive assist information of the series 
parking mode when the parking position is on the 30 
road. 

30. The vehicle drive assist devtee according to any 
of claims 27 to 29. wherein the drive assist means 

for selecting the drive assist infomnation of the nor- 3S 
ma\ parking mode or the series parking mode in ac- 
cordance with a change a steering angle for 
steering the vehicle. 

31. A vehicle parking assist device comprising: ^ 

a plurality of cameras to cover different photo- 
graphing areas from each other, thereby to pick 
up a scene around the vehicle; 
display means tor displaying images picked up ^ 
by the cameras, the display means having a 
display screen; and 

drive assist means for divkiing the display 
screen of the display means Into a plurality of 
display areas, and displaying the images by the ^ 
plurality of cameras on the display areas divkJ- 
ed, thereby effecting a drive assist. 

32. The vehicle drive assist device according to 
claim 31 , further comprising: 55 

drive condition detecting means for detecting 
a vehicle drive condrtbn. 

wherein the drive assist means selectively 



changes a display in accordance with the vehicle 
drive condition detected by the drive condition de- 
tect'ong means. 

33. The vehble drive assist device according to 
claim 31 or 32. wherein the drive assist means over- 
lays the vehicle in simplified form on the images 
picked up by the plurality of cameras and displayed 
on the screen of the display means. 

34. The vehkile drive assist devbe according to any 
of claims 31 to 33, wherein the drive assist means 
moves a display positk>n of the vehble on the dis- 
play screen according to an image from the camera. 

35. The vehble drive assist device according to 
claim 33 or 34. wherein the drive assist means op- 
erates to display directions and photographrig are- 
as covered by the cameras when the vehicle is dis- 
played in simplified form. 

30. The vehicle drive assist device according to any 
of claims 31 to 35, the vehicle drive assist device 
mounted in the vehicle having a car-carried device 
including a navigation device and/or audb devbe. 

wherein the drive assist means for dh/iding the 
display screen of the display means rtto a plurality 
of segmental display areas, and the images from 
the plurality of cameras and an image from the car- 
carried device are displayed on the segmental dis- 
play areas, thereby effecting the drive assist. 

37. The vehicle drive assist devbe according to any 
of claims 31 to 36, wherein the drive assist means 
changes the images from the plurality of cameras 
to be displayed on the display screen at a predeter- 
mined time Interval 

38. The v^icle drive assist device according to 
claim 37, wherein the drive assist means uses a 
wipe to change the images. 

39. The vehicle drive assist devbe accordrtg to any 
of claims 31 to 38, wherein one of the plurality of 
cameras is for pbking up a scene of a side area of 
the vehbie, and the drive assist means operates to 
display a side image concerning a direction indica- 
tor, being interconnected with an operatbn of the 
directbn indicator 

40. The vehbie drive assist devbe accord^g to any 
of claims 31 to 39, wherein the drive assist means 
changes the images one to another in accordance 
with a steering angle of turn of a steering wheel for 
steering the vehbie. 

41. The vehbie drive assist device according to 
clfium 40. wherein the drive assist means changes 
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a condition of dividing the screen of the display 
means in accordance with a steering angle oT the 
steering wheel 

42. The vehicle drive assist device according to any 5 
of claims 31 to 41 , further conrprising an obstacle 
sensor for detecting presence or absence df an ob- 
stacle on a vehicle traveling path. 

wherein when the obstacle sensor detects the 
obstacle, the drive assist means causes the display io 
means to display a sensing direction of the obslacle 
sensor. 

43. The vehicle drive assist device according to 
clsdm 42, wherein when the obstacle sensor detects 
an obstacle, the drive assist means causes the dis- 
play means to display an image from the camera 
piclmg up a sensing direction of the obstacle sen- 
sor. 

20 

44. The vehicle drive assist device according to 
claim 42, wherein when the obstacle sensor detects 
the obstacle, the drive assist means causes the dis- 
play means to shift a display position of the image 
from the camera picking up the ser^sing direction of 
the obstacle sensor, to the center of the screen of 
the display means or to expand the display. 

46. The vehwle drive assist device according to any 
of claims 42 to 44. wherein the drive assist means 30 
causes the display means to overlay an alarm on a 
display of the sensing direction of the obstacle sen- 
sor. 

46. The vehicle drive assist device according to any 3S 
of claims 31 to 45. wherein when adjacent images 

of the can^eras adjacently disposed are sbnultane- 
ously displayed, the drive assist means adjusts the 
display areas and positions of the adjacent images 
to connect the adjacent images continuously with <o 
each other. 

47. The vehicle drive assist device according to any 
of claims 31 to 46. wherein the plurality Gf cameras 
are disposed to take scenes of the front, front left. 45 
front right, back or rear left and back or rear right 
areas of the vehicle. 

48. The vehicle drive assist devce according to 
claim 47, wherein the drive assist means divides the so 
display screen of the display means into upper and 
lower display areas, and causes the display means 

to display an image in front of the vehicle on the 
central region of the upper portion of the screen, im- 
ages of front left and front right images on the left 55 
arxl right display areas of the upper display area, 
and an image of the rear area of the vehicle on the 
central area of the tower display area of the display 



screen, images of the rear left and rear right on the 
left and right display areas cjI the lower display area 
of the display screen of the display means. 

49. The vehicle drive assist device according to 
claim 47. wherein the drive assist means causes the 
display means to display an image selected from 
the images picked up by the plurality of cameras. 

50. The vehicle drive assist device according to 
claim 47. wherein the drive assist means causes the 
display means to display the inr^ges output from the 
plurality of cameras having the photographing are- 
as successively in scrolling manner. 

51. The vehkile drive assist device according to any 
o1 claims 31 to 50. wherein the display me£ins in- 
cludes a touch panel, and the drive assist meeins 
changes an image display cor>ditk>n according to an 
input to the touch panel. 

52. The vehicle drive assist device according to 
claim 51 . wherein according to the input to the touch 
panel, the drive assist means enlarges and displays 
an image at an input position at a predetermined 
time, and after the predetermined time elapses, the 
drive assist means put back the image enlarged and 
displays the image on the display screen. 

53. A vehicle parking assist device comprising: 

a camera for picking up an image in a frontward 
area of a vehicle; 

storing means for reading and string the image 
pteked up by the camera; and 
drive assist means for acquiring inf ormatkxi for 
a vehicle drive assist on the t»asis of the inr^age 
stored in the storing means. 

54. The vehicle drive assist device according to 
claim 53, further comprising display means for dis- 
p^ing the anage from the camera. 

55. A vehicle drive assist device according to claim 
53 or 54, further comprising vehicle detecting 
means for detecting an other vehicle forcibly run- 
ning into a place in front of the vehicle by processing 
the image from the camera. 

66, A vehicle parking assist device comprising: 

a camera attached to the top of a vehicle, the 
camera for picking up an image around the ve- 
hicle as viewed from the top of the vehk^le; 
display means for displaying the bnage picked 
up by the camera; and 

drive assist means for detecting a limit of a ve- 
hicle height from the image picked up by the 
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camera, and intormtng a driver of the detection 
•result as drive assist Information. 

67. A vehicle parking assist device comprising: 

5 

a camera for picking up an image in frontward 
and backward areas of a vehicle; 
display means for displaying an Image picked 
up by the camera; 

running condition detecting means for detect- io 
ing running conditron of the vehicle; and 
drive assist means for carrying out drive assist 
in accordance with running conditions detected 
by the running conditbn detecting means In 
such a manner that In a normal running, the dis- is 
play means displays an image of the frontward 
area of the vehicle, and in a backward running, 
the display rr^eans displays more brightly an im- 
age of the backward area than an Image of the 
forward area. ^ 

58. A vehicle parking assist device comprising: 

a carnera for picking up an image in the front- 
ward and backward areas of a vehicle; ^5 
display means for displaying the Image pk^ked 
up by the camera; 

running condition detecting means for detect- 
ing running conditkxi of the vehicle; arxj 
drive assist means for carrying out drive assist 30 
In accordance with running conditbns detected 
by the running state detecting rmans by use of 
such a display that in a normal running, the dis- 
play mearts dispteys an image of the frontward 
area of the vehble, and in a backward running, ^ 
the display means displays more brightly sin im- 
age of the backward area than an image of the 
forward area. In place of a display frame for 
back mirrors. 

40 

69. The vehk:le drive assist device according to 
claim 58, wherein the drive assist means modifies 
a backward area inruige displayed in the display 
frame for the back mirrors Into an image having a 
field angle equal to thatch the back mirror, and caus- ^ 
es the display means to display the image modified 
in field angle. 

60. A vehicle drive assist device comprising: 

so 

a camera mounted on a vehicle, the camera for 
picking up an image of an area existing in an 
advancing direction of the vehicle; 
a steering angle sensor for detecting a steering 
angle of the steering wheel of the vehicle; ^ 
traveling path predicting means for catcutating 
a predictive traveling path curve depending on 
a steering angle detected by the steering angle 



sensor 

drive assist means tor assisting a driver in the 
driving operatk>n by adding a 3-dimensional in- 
formation image containing a height of a vehicle 
ak>ng the predictive traveling path curve de- 
rived from the traveling path predicting means; 
display nrveans for displaying the Image output 
from the camera and an trr^ge output the drive 
assist means; and 

an obstacle sensor for detecting an obstacle 
existing in the vehble advancing directk>n; 

wherein the drive assist means changes a dis- 
play of the 3-dimenslonal information Inrrage at a po- 
sition on the predictive traveling path curve, whk*> 
is ctose to a positk>n where an obstructive object is 
detected by the obstacle sensor, to a display which 
is different from displays of the 3-dimensior^l image 
at other positions. 

61. A vehicle drive assist device according to claim 
60, wherein the drive assist means displays the 
3-dimensk3nat information image in the form of 
planes each having a predetermined shape which 
are arrayed at fixed distances ak^ng the predknive 
traveling path curve. 

62. The vehicle drive assist device according to 
clciim 60, wherein the drive assist means moves a 
plane of a predetermined shape representing a 
height of the vehicle along the predfetive traveling 
path curve. 

63. The vehicle drive assist device accordirig to 
cicum 62, wherein the drive assist means stops the 
plane of a predetermined shape at a position cbse 
to a detection position where the obstructive object 
is detected. 

64. The vehk;le drive assist devk^e according to any 
of claims 60 to 63, wherein the drive assist means 
changes a color of the 3-dimensional information 
image at the position close to the detect kxi position. 

65. The vehicle drive assist device according to 
clEiim 60, wherein the drive assist means displays 
the 3-dimentkxial information image in the form of 
a simulation image in which a sett vehk^le moves in 
the image picked up by the camera. 

66. A vehk:te parking assist devk:e for assisting a 
driver in a parking operatk^n comprising: 

a camera for pk^king up an image of an area 
existing in an advancing direction of a vehble; 
parking position detecting means for detecting 
a target parking position In whfch the vehicle Is 
to be parked based on the image picked up by 
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the camera; 

. steering angle calculating means tor calculat- 
ing a steering angle necessary for the moving 
of the vehicle to the target parking position de- 
tected by the parking position detecting means; 5 
steering angle detecting means for detecting a 
steering angle of the vehicle; and 
parking assist means for presenting a steering 
operation guide to the driver on the basis of the 
result of comparing a steering angle detected io 
by the steering angle deteclarig means with a 
steering angle calculated by the steering angle 
calculating means. 

67. The vehicle parking assist device according to »5 
claim 66, further comprising: 

traveling path predicting means for calculating, 
depending on a steering angle, a predictive 
traveling path curve akxig which the vehicie will so 
travel; and 

touch judging means for judging as to whether 
or not the vehicle traveling akxtg the predictive 
traveling path cun^e calculated by the traveling 
path predicting means will touch an obstructive 25 
object; 

wherein when a steering angle calculated by 
the steering angle caksulating mearis is out of a 
range of steering angles within whrch a steering 30 
wheel may be turned for steering or when the touch 
lodging means judges that the vehicle traveling 
along the predictive travernng path cun/e, which is 
calculated by the traveling path predicting means 
depending on the steering angle, will touch the ob- 35 
structive object, the parking assist me£ins urges the 
driver to reverse the advancing direction of the ve- 
hicle. 

68. A vehicle parking assist device for assisting a ^ 
driver in his parking operation comprising: 

a camera for pk^king up a image of an area ex- 
isting in an advancing directk)n of a vehicle; 
parking space reco^iizing means for detecting ^ 
a parking space tn which the vehk^le is to be 
parked, based on the enage picked up by the 
camera; and 

parking assist means for judging as to if a park- 
ing stopper for blocking the advancing of the 5o 
vehfcile exists in the partcing space recognized 
by the parking space recognizing means and 
for informing the driver of the result of the judge- 
ment. 

65 

69. The vehicle partcing assist devrce according to 
any of claims 66 to 68. further comprising votee 
gukJe means for carrying out a guide by the parking 



assist by voice. 

70. The vehicle parking assist devico according to 
claim 69, wherein the voice guide means also gives 
the driver warning to urge the driver to watch envi- 
ronmental conditions around the vehicle. 

71. The vehicle park'ng assist devk^e according to 
any of claims 66-70. further comprising display 
gukJe means for visually presenting the guide by the 
parking assist together with the image by the cam- 
era. 

72. A vehk^le parking assist device for assisting a 
driver using image tnfornnatkjn when the driver 
backs a vehicle into a parking space, the vehicle 
parking assist devce comprises: 

a canr^ra for prcking up an image of a backward 
area of the vehicle; 

display means for displaying the image of the 
backward area picked up by the camera, the 
display means having a screen; and 
parking assist means for assisting the driver in 
the parking using a display on the screen of the 
display means in whfch the guide lines pro- 
kxiged from the lines defining the width of the 
vehble and distance lines are overlaid on the 
backward area image. 

73. A vehfcle parking assist devfce for assisting a 
driver using 'mage infonrDatkjn when the driver 
t>acks a vehicle into a parking space, the vehicle 
parking assist devbe comprises: 

a camera for picking up a image of a backward 
area of the vehicle; 

display means for displaying the image of the 

backward area pbked up by the camera, the 

display means havrig a screen; 

a steering angle sensor for detecting a steering 

angle of the self vehble; 

traveling p>ath predicting means for predicting a 

traveling path of the self vehicle on the basis of 

a steering angle detected by the steering angle 

sensor and for calculating a predictive traveling 

path curve representing the result of the predk;- 

tkxi; 

parking position judging mear^ tor judging a 
parking position at whk^ the self vehicle is to 
be parked; and 

parking assist means for effecthg a parking as- 
sist in such a way that a length of a predk^tive 
traveling path curve cateulated by the traveling 
path predicting means is adjusted in accord- 
ance with a distance ranging to a parkrig posi- 
tk>n judged by the parking position judging 
means, and the predictive traveling path curve 
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length adjusted fe overlaid on a backward area 
image on the screen of the display means. 

74. A vehicle parking assist device for assisting a 
driver using imago informat k>n when h e backs a ve- s 
hide into a parking space, the vehicle parking assist 
device comprises: 

a camera for picking up an image of a backward 
area of the vehicle; lo 
display means for displaying the image of the 
backward area picked up by the camera, the 
display mearis having a screen; 
a steering angle sensor for detecting a steering 
angle of the self vehicle; i5 
traveling path predicting means for predicting a 
traveling path of the roof portion of the self ve- 
hicle on the basis of a steering angle detected 
by the steering angle sensor and for calculating 
a predictive traveling path curve representing 20 
the result of the prediction; arxJ 
parking assist means for effecting a parking as- 
sist in such a way that a predictive traveling 
path curve of the roof portion of the vehicle, 
which is calculated by the traveling path pre- 25 
dieting means, is overiaki on a backward area 
irmge on the screen of the display means. 

76. A vehicle parking assist devbe for assisting a 
driver using image information when he backs a ve- 30 
hide into a partcing space, the vehrcle parking assist 
device comprises: 

a CEimera for picking up an image of a backward 
area of the vehicle; 05 
display means for displaying the irr^ge of the 
backward area picked up by the camera, the 
display means having a screen; 
a steering angle sensor for detecting a steering 
angle of the self vehicle; 40 
traveling path predicting means for predcttng a 
traveling path of the self vehk^le on the basis of 
a steering angle detected by the steering angle 
sensor and for cak^ulating a predk:tive traveling 
path cun^e representing the result of the predic- ^ 
Won; 

vehicle projection means arranged such that 
the vehicle projection means judges if other ve- 
hicles part< in pa rising spaces kxated adjacent 
to a partcing space under photographHng by the so 
camera, and when other veNcfes park therein, 
the vehicle projectbn means cabulates a pro- 
jective line of the vehicle on the ground; and 
parking assist nneans for effecting a parking as- 
sist in such a way that a predictive traveling 55 
path cunre cakrutated by the traveling path pre- 
dicting means and a projective line of the vehi- 
cle to the ground calculated by the vehicle pro- 



jectton means are overlaki on a backward area 
image on the screen of the display means. 

76. A vehicle parking assist device for assisting a 
driver using image information when he backs a ve- 
hicle into a parking space, the vehicle parking assist 
devbe conprises: 

a camera for picking up a scene cf a backward 
area of the vehicle; 

display means for displaying the innage of the 
backward area pk:ked up by the camera, the 
display means having a screen; 
plane nrkodel generating means for generating 
from the backward area innage prcked up by the 
camera a plane model containing a parking 
space in which a seK vehicle is to be parked 
and the parking spaces located adjacent to the 
parking space, together with the self vehicle 
and other vehrcles being pariced; and 
parking assist means for effecting a parking as- 
sist by displaying a plane model generated by 
the plane model generating means on the 
screen of the display means. 

77. A vehicle parking assist device according to 
claim 76, wherein the parking assist mear^s displays 
an image on the screen of the display means so that 
the backward direction of the setf vehbte is oriented 
downward. 

78. The vehicle parking assist devk^e according to 
claim 76 or 77, wherein the parkrrg assist mear^ is 
capable of selectively displaying the backward area 
rnage output from the camera and the parking as- 
sist image or the plane model to be displayed over- 
lakl on the backward area image on the screen of 
the display means 

79. A vehble parking assist 6ev\ce for assisting a 
driver using image information when he backs a ve- 
hicle into a partdng space, the vehicle parking assist 
devbe comprises: 

a camera for pk^king up an inr^ge of a backward 
area of the vehicle; 

display means for displaying the image of the 
backward area prcked up by the cannera; 
a tmer for counting a predetermined time; 
direction detecting means for detecting a 
change of the advancing direction of the vehi- 
cle; and 

parking assist means arranged such that when 
the directkxi detecting means detects a change 
of the advancing direction of the vehrcle to the 
backward direction, the parking assist means 
displays the backward area image picked up by 
the camera on the screen of the display means 
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to assist the driver in his parking operation, and 
. when the direction detecting means detects a 
change of the advancing direction of the vehicle 
from the backward direction to the forward di- 
rection, the parking assist causes the timer to s 
start the counting of time, and continues the 
parking assist based on the backward area dis- 
play on the screen of the display means till a 
time set in the timer elapses. 

10 

80. A vehicle parking assist device in which when a 
driver backs a vehble into a parking space between 
adjacent vehicles of those being parked in a row, 
said vehcle parking assist device assists the driver 
in his parking operation by image-lnformatic»i basis is 
gukie. said vehicle parking assist device compris- 
ing: 

acameia tor picking up an image of a backward 
area <rf the vehicle; 20 
a steering angle sensor for detecthg a steering 
angle to steer the vehfcle; 
traveling path predicting mear»s for predicting a 
traveling path of the vehicle on the basis of a 
steering angle detected by said steering angle 2S 
sensor and for calculating a predictive traveling 
path cun^e; 

timing judging means for detecting a target 
parking position on the basis of the irrage 
picked up by said camera and for judging a tim- 30 
ing to reversely turn a steering wheel by an 
amount of tum of the steering wheel necessary 
to move the vehicle to the target parking posi- 
tion; 

parking assist means for generating a compos- 3S 
ite image of an image derived from said camera 
and a predictive traveling path curve predicted 
by sakJ traveling path predicting means, and for 
adding guide Intormatkm for a steering opera- 
tion defined by a reverse4um timing judged by 4o 
saki timing judging means to said connposite 
image, whereby said parking assist means as- 
sists the driver in the serial parking operation; 
and 

display means for display an image derived 4S 
from said parking assist means. 



natkm of lighting conditk>ns of a hazard lamp and/ 
or winker lamp. 

83. The vehicle parking assist device according to 
claim 82, wherein said paricing assist means judges 
which side of the road is used for saki series parking 
on the basis of a combinatk>n of light rig conditions 
of the hazard lamp and/or winker tamp, and adds 
said guide information to sakJ composite anage ac- 
cording to the judgement result. 

84. The vehicle parking assist devk^e according to 
claim 80, wherein saki parkkig assist n^ans gen- 
erates an kieal traveling path ranging from the 
present position to a target parking positbn detect- 
ed by said timing judging means, for said steering 
gukie inforrr^tkHi. 

85. The vehicle parking assist devk^ according to 
any of clalnns 60 to 84. further comprisang lane nron- 
itoring means for recognizing border lines d a traffic 
^e and rrKxiitoring an out-of-lane of the vehicle on 
the basis of the border line recognitkxi. 

86. The vehicle parkrtg assist devk:e according to 
claim 85, wherein said parking assist means judges 
whether or not the vehicle may back to a target park- 
ing position detected by saki timing judgong nrteans 
within a range of steering angles within whksh the 
steering wheel may be turned, and whether or rK>t 
the vehtele nKives out of the traffte lane monitored 
by said lane oKxirtoring nneans. and saki parking as- 
sist means assists the driver in the series parking 
on the basis of the judgement results. 



81 . The vehk;le parking assM device according to 
claim 80, wherein said parking assist means adds 
an oblique line as said gukJe lnformatk>n for the so 
steering operation to a posilkxi on a predkJted 
traveling path curve at which the steering wheel is 
to be reversely turned. 



62. The vehk:le parking assist devk:e according to ss 
claim 80 or 81, wherein sakJ parking assist means 
assists the driver in the series parking on the basis 
a backward movement of the vehicle and a combi- 
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